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Abstract 


The  acquisition  of  new  weapon  systems  is  a  multi¬ 
billion  dollar  industry,  whose  cost  is  matched  in  magnitude 
only  by  its  complexity.  Quite  frequently  the  final  costs  of 
these  weapon  systems  greatly  exceed  their  original  cost 
estimates.  Initiatives  have  been  aimed  at  acquisition  cost 

reduction,  but  to  a  large  extent  the  problem  still  persists. 

/ 

The  purpose  of  this  investigation-  is  to  explore 
possible  means  for  improving  the  efficiency  and  cost-effec¬ 
tiveness  of  the  acquisition  management  process.  This  study 
examines  the  contract  amendments  that  transpired  during  the 
Full  Scale  Engineering  Development  ( FSED)  phase  of  the  Low 
Altitude  Navigation  and  Targeting  Infrared  System  for  Night 
(LANTIRN)  weapon  sys tem , , managed  under  the  Deputate  for 
Reconnaissance,  Strike,  and  Electronic  Warfare  of  Aeronau¬ 
tical  Systems  Division.  /Contract  changes  and  their  subse- 
j  quent  costs  are  grouped  relative  to  their  impact  on  (1)  the 

scope  of  the  contract,  (2)  the  product  delivery  schedule  of 
the  contract,  and  (3)  the  design  of  the  weapon  system.  In 
i  addition,  various  other  factors  are  considered  such  as  the 

I 

'  point  in  contract  performance  at  which  the  change  occurred, 

the  length  of  the  period  of  performance,  the  page  length  of 
j  the  Engineering  Change  Proposal  (ECP) ,  and  the  page  length 


of  the  Statement  of  Work  (SOW)  alteration.  All  costs  are 

adjusted  to  base  year  FY36  dollars  to  control  for  inflation. 

( 

Contract  changes  affecting  the  Statement  of  Work, 
including  design  changes,  were  found  to  contribute  the 
greatest  amount  to  contract  cost.  Extensions  to  the  product 
delivery  schedule  also  contributed  significantly  to  contract 
change  cost.  The  use  of  change  orders  to  implement  contract 
change  produced  increased  costs,  and  no  significant  differ¬ 
ence  was  found  between  the  contractor's  Not- to-Exceed  esti¬ 
mate  and  final  negotiated  costs  for  change  orders.  Future 
LANTIRN  contract  actions  should  seek  to  minimize  these 
activities. 
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AN  INVESTIGATION  OF  THE  IMPACT  OF  CONTRACT  CHANGES  ON 
COST  GROWTH  WITHIN  THE  LANTIRN  SYSTEM  PROGRAM  OFFICE 


I .  Introduction 

This  chapter  presents  background  information  on  the 
status  of  the  systems  acquisition  segment  of  the  Department 
of  Defense  budget  and  its  relationship  to  the  national 
economy.  The  specific  research  question  is  stated,  along 
with  a  listing  of  the  component  investigative  questions. 
Finally,  conditions  are  identified  which  delimit  the  scope 
of  this  study. 

Background 

As  federal  expenditures  continue  to  increase,  the 
national  defense  budget  has  consistently  garnered  a  major 
component  of  the  federal  budget  (3:35-42).  Much  of  these 
funds  has  been  devoted  to  new  weapon  system  acquisition.  As 
technology  advances,  the  complexity  of  Air  Force  weapon 
systems  has  increased  proportionately.  The  chief  priority 
of  the  weapon  systems  acquisition  community  appears  to  be 
that  of  obtaining  the  highest  level  of  performance  possible, 
while  incorporating  the  latest  in  technological  sophis¬ 
tication.  Unfortunately,  such  an  objective  does  not  come 
cheaply.  The  spiraling  costs  of  new  weapon  systems  have 


drawn  increased  attention  from  all  sectors  of  society  con¬ 
cerned  with  the  expanding  defense  budget.  In  particular. 
Congress  has  expressed  concern  over  the  often  dramatic 
increases  in  total  costs  for  weapon  systems  beyond  original 
cost  estimates.  Such  concern  was  evidenced  in  the  U.S. 
Congress  House  of  Representatives  Committee  on  Government 
Operations  report  entitled  "Inaccuracy  of  Department  of 
Defense  Weapons  Acquisition  Cost  Estimates",  published  in 
1979.  This  report  explicitly  detailed  cost  growth  in  de¬ 
fense  systems  for  fiscal  years  1969-1973  (3:82-91).  Con¬ 
taining  extensive  cost  growth  within  Air  Force  contracts  is 
a  very  significant  problem. 

Research  Question 

Air  Force  contracts  with  industry  have  traditionally 
been  guided  by  annual  budget  appropriations  for  the  develop¬ 
ment  of  a  particular  weapon  system.  Cost  estimates,  which 
form  the  basis  for  the  Air  Force  requests  for  appropria¬ 
tions,  are  often  exceeded  because  of  changes  or  modifica¬ 
tions  made  to  a  contract  during  its  execution.  Information 
is  needed  on  the  relationships  between  modifications  to  an 
Air  Force  contract  and  the  subsequent  increases  to  contract 
cost.  This  investigation  will  answer  the  question,  "For  a 
recently  completed  Air  Force  development  contract,  what 
were  the  impacts  of  contract  changes  on  cost  growth?".  3y 
establishing  and  verifying  such  relationships,  additional 


information  will  be  available  to  aid  the  program  manager  in 
better  understanding  the  cost  impact  of  contract  changes. 
This  understanding  will  enable  managers  to  take  corrective 
actions  when  identified  cost  growth  causes  are  within  their 
power  to  control. 


Investigative  Questions 

In  order  to  answer  the  research  question,  the 
following  investigative  questions  must  first  be  considered: 

1.  What  was  the  effect  of  contract  changes  to  the 
contract  structure? 

a.  Was  there  a  significant  cost  difference  between 
changes  within  the  scope  or  outside  the  scope  of  the  con¬ 
tract? 

b.  Did  the  page  quantity  of  a  statement  of  work 
(SOW)  change  have  any  correlation  with  cost? 

c.  Was  contract  type  a  factor  in  the  cost  of 

changes? 

2.  What  was  the  effect  of  time  on  contract  change? 

a.  Is  there  a  significant  cost  difference  between 
change  orders  and  supplemental  agreements? 

b.  Is  there  a  significant  cost  difference  between 
change  orders  and  supplemental  agreements  involving  SOW 
changes? 

c.  Is  there  a  significant  cost  difference  among 
change  orders  which  required  differing  time  spans  for  defin 
i tization? 
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d.  Is  there  a  significant  cost  difference  between 
contract  changes  with  differing  time  spans  for  receipt  of 
the  cost  proposal  and  the  final  approval  date? 

e.  Is  there  a  significant  difference  between  the 
Not-To-Exceed  (NTE)  estimates  and  the  final  negotiated  price 
of  change  orders? 

f.  Is  there  a  relationship  between  the  point  of 
time  in  contract  duration  at  which  the  change  occurs  and 
cost? 

g.  Is  there  a  difference  between  contract  change 
costs  which  occur  before  or  after  the  Critical  Design  Re¬ 
view? 

3.  What  was  the  effect  of  contract  changes  to  the 
product  delivery  schedule? 

a.  Does  the  establishment  of  new  hardware/sof twara 
deliverables  and  schedule  delays  significantly  impact  cost 
versus  other  contract  changes? 

b.  Does  the  establishment  of  new  hardware/software 
deliverables  and  schedule  delays  significantly  impact  cost 
versus  other  contract  changes  involving  SOW  changes? 

4.  To  what  extent  did  design  changes  impact  the 
contract? 

a.  Was  the  page  quantity  of  an  engineering  change 
proposal  a  factor  which  affected  cost? 

b.  Was  there  a  significant  cost  difference  between 
the  lengths  of  the  periods  of  performance  for  a  contract 
change? 
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Scope  of  Study 

This  study  will  examine  the  effects  of  contract  change 
on  cost  growth  within  the  full  scale  development  contract 
(after  contract  restructure) for  the  Low  Altitude  Navigation 
and  Targeting  Infrared  System  for  Night  (LANTIRN)  weapon 
system.  The  LANTIRN  program  is  being  managed  under  the 
Deputy  for  Reconnaissance,  Strike  and  Electronic  Warfare 
Division  of  Aeronautical  Systems  Division,  Air  Force  Systems 
Command.  LANTIRN  is  a  navigation  and  targeting  system 
designed  to  provide  high-resolution  infrared  imagery  and 
precision  targeting  functions  for  high-speed,  low-altitude 
flight  and  air-to-ground  weapon  delivery  over  any  terrain, 
at  night,  and  in  limited  visibility  conditions.  The  system 
is  composed  of  a  navigation  pod  and  a  targeting  pod,  and  is 
being  developed  for  Tactical  Air  Command  to  operate  on  the 
F-15E,  F-16 ,  and  A-10  aircraft. 

All  findings  and  conclusions  of  this  study  are  limited 
to  the  LANTIRN  program,  and  should  not  be  extrapolated  to 
other  weapon  systems  without  further  research.  In  addition, 
this  study  will  focus  only  on  cost  growth  attributed  to 
modifications  to  the  LANTIRN  contract.  Increases  in  cost 
due  to  other  causes  will  be  identified  where  possible,  but 
not  investigated. 


II. 


Literature  Review 


The  purpose  of  this  chapter  is  to  review  current 
literature  which  identifies  numerous  possible  causes  for  the 
rapid  growth  in  the  costs  of  new  weapon  systems.  These 
causes  will  be  examined  as  applied  to  changes  in  contract 
type,  prices,  schedules,  and  system  design.  Prior  to  this 
discussion,  various  interpretations  of  the  concept  of  cost 
growth  and  its  measurement  will  be  reviewed. 

Cost  Growth 

Cost  growth  is  an  elusive  term  with  different  meanings 
to  different  people.  Some  would  define  cost  growth  as  "... 
the  net  increased  cost  to  the  Government  of  items  or  servic¬ 
es  procured  or  to  be  procured"  (14:94).  Others  feel  that 
cost  growth  amounts  to  the  difference  between  the  initial 
cost  estimate  for  acquisition  of  a  new  weapon  system  and  the 
final,  actual  cost  of  the  system  (15:37).  Regardless  of  the 
precise  definition,  today's  major  weapon  systems  exhibit  a 
consistent  tendency  to  significantly  exceed  their  original 
cost  estimates.  Such  cost  increases  are  undesirable  because 
many  Air  Force,  Department  of  Defense,  and  congressional 
decisions  which  affect  the  budget  and  defense  priorities  of 
the  United  States  are  based  on  cost  estimates  (13:116). 

Concern  over  cost  growth  has  generated  interest  from 
the  very  top  of  the  government  executive  branch.  In  March 


of  19C2,  President  Reagan  issued  a  memorandum  to  Secretary 
of  Defense  Weinberger  requesting  an  investigation  into 
Department  of  Defense  (DOD)  programs'  cost  growth.  This 
action  served  to  make  the  reduction  of  cost  growth  a  priori¬ 
ty,  even  in  an  era  of  increased  defense  budgets.  President 
Reagan's  action  was  not,  however,  the  nation's  first  atten¬ 
tion  to  cost  growth.  The  term  was  first  coined  in  1969  by 
the  Department  of  Defense,  to  describe  total  cost  increases 
in  defense  programs  (14:93-94). 

The  degree  of  cost  growth  within  a  program  cannot  be 
assessed  without  some  means  of  measurement.  Typically  cost 
growth  is  measured  by  calculating  how  much  greater  the 
current  estimate  of  the  total  system  acquisition  cost  is 
than  the  initial  development  estimate  (3:83).  The  develop¬ 
ment  estimate  is  an  estimate  of  the  total  system  acquisition 
cost  prior  to  systems  development,  whereas  the  current 
estimate  includes  all  costs  which  have  been  incurred  by  the 
system  at  the  date  of  the  estimate  plus  a  projection  of  the 
required  costs  to  complete  the  system.  If  cost  growth  is 
encountered  during  the  development  of  a  major  weapon  system 
(greater  than  $230  Million  in  RDT&E  or  $1  Billion  in  Pro¬ 
curement  costs) ,  it  is  reported  in  the  DOD  Selected  Acqui¬ 
sition  Report  (3AR) ,  which  is  a  yearly  report  to  Congress. 
Seven  categories  of  cost  growth  are  displayed  for  the  meas¬ 
urement  of  cost  growth  in  these  reports.  These  categories 
are  economic  changes,  quantity  changes,  engineering  changes. 
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support  changes,  schedule  changes,  estimating  changes,  and 
other  changes. 


Explanations  for  cost  growth  run  the  spectrum  from 
inflation  to  poor  management  practices.  Dr.  Gardiner  L. 
Tucker,  a  former  Assistant  Secretary  of  Defense  for  System 
Analysis,  contends  that  the  major  contributors  to  cost 
growth  are  uncertainty,  unrealistically  low  cost  estimates, 
and  inattention  to  proper  system  definition  (14:94-95).  A 
recent  study  identified  four  major  categories  of  uncertainty 
within  a  program,  those  being  target,  technical,  process, 
and  internal  program  uncertainty.  Target  uncertainty  refers 
to  establishing  cost,  schedule,  and  performance  goals. 
Technical  uncertainty  entails  unpredictable  technical  prob¬ 
lems.  Internal  uncertainty  refers  to  managerial  strategy. 
Process  uncertainty  is  concerned  with  the  availability  of 
resources  (18:18). 

Another  viewpoint  asserts  that  low  cost  estimates  are 
the  major  factor  behind  cost  growth.  An  inclination  to 
develop  low  cost  estimates  is  the  result  of  an  environment 
which  produces  pronounced  industry  competition  and  military 
Service  rivalries  (3:39).  As  such,  competition  within  and 
among  military  services  for  shares  of  the  budget,  and  compe¬ 
tition  among  contractors  to  submit  the  lowest  (and  therefore 
most  desirable)  cost  bid,  will  perpetuate  unrealistic  ini¬ 
tial  estimates,  and  thus  eventual  cost  growth  (14:95). 
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An  example  serves  to  illustrate  this  downward  bias  in 


cost  estimates.  By  the  end  of  fiscal  year  1978,  current 
estimates  of  total  program  cost  growth  for  all  major  DOD 
weapon  systems  acquired  since  1969  reached  $215  billion. 

Of  this  $215  billion,  57  percent  was  for  the  Navy,  25  per¬ 
cent  for  the  Air  Force,  and  18  percent  for  the  Army.  The 
original  development  estimates  for  these  same  systems  was 
$150  billion,  which  translates  into  a  cost  growth  of  nearly 
45  percent  (3:83-84). 


Figure  2.1  Dollar  Comparison  of  Development  Estimates 
and  Current  Estimates  of  Defense  Systems  for  Fiscal 
Years  1969-1978  (Adapted  from  3:84) 


Figure  2.1  displays  the  trend  in  cost  growth  for  all 
DOD  major  weapon  systems  from  1969  through  1978  by  comparing 
the  initial  development  estimate  and  current  total  program 
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cost  estimate.  The  difference  between  development  estimates 
and  current  estimates  has  increased  from  $10  billion  in 
1969  to  approximately  $65  billion  in  1978.  This  trend  can 
also  be  displayed  on  a  percent  basis. 
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Figure  2.2  Percentage  Cost  Growth  of  Defense 
Systems  for  Fiscal  Years  1969-1978 
(Adapted  from  3:85) 


Figure  2.2  shows  a  gradual  increase  in  the  difference 
between  current  estimates  and  development  estimates,  ranging 
from  12  percent  in  1969  to  17  percent  in  1973.  After  1973, 
the  graph  reveals  a  sharp  increase  with  periods  where  cur¬ 
rent  estimates  exceeded  development  estimates  by  greater 
than  50  percent.  High  levels  of  inflation  have  been  sug¬ 
gested  as  a  significant  contributor  to  cost  growth  occur¬ 
ring  after  1973.  Another  pattern  extracted  from  this  data 


is  that  cost  estimates  tend  to  escalate  well  beyond  the 
levels  originally  anticipated  as  a  program  progresses 
through  the  acquisition  cycle  (3:83-34). 


Services 

Economic 

Quantity 

Engineering 

Support 

Schedule 

Estimating 

Other 

Army 

1 

2 

7 

5 

4 

3 

6 

Navy 

2 

1 

5 

6 

3 

4 

7 

Air  Force 

1 

2 

5 

4 

3 

7 

6 

DOET 

1 

2 

6 

5 

3 

4 

7 

Figure  2.3  Ranking  of  the  Relative  Contribution  of  Seven 
Major  Categories  Toward  Cost  Growth,  Fiscal  Year  1979 

(Adapted  from  3:87) 

The  effects  of  cost  growth  can  also  be  classified  by 
its  causes.  Figure  2.3  presents  a  ranking  of  the  seven 
major  DOD  cost  growth  categories  for  the  Services,  as  com- 
piled  from  data  reported  in  the  U.S.  Congress.  Much  simi¬ 
larity  exists  within  the  ranking  of  these  cost  growth  causes 
among  the  Services.  The  impact  of  inflation  accounts  for 
more  cost  growth  than  any  other  identified  factor,  amounting 
to  about  30  percent  of  the  total.  Quantity  changes  ranked 
second,  followed  by  schedule  changes  and  cost  estimating 
changes  ( 3 : 87-83) . 
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Other  commonly  identified  causes  for  cost  growth 
include  budget  instability,  low  production  rates,  lack  of 
interservice  standardization,  inflation,  excessive  documen¬ 
tation,  and  poor  subcontractor  control  ( 5 : 24 ; 14 : 100) .  These 
factors  have  led  some  to  the  conclusion  that  cost  growth 
will  occur  "...simply  due  to  the  market  environment  in  which 
systems  are  procured  coupled  with  the  great  uncertainties 
and  risks  that  accompany  the  development  of  new  weapon 
systems"  (3:32)  .  Finally,  opinion  exists  that  many  of  the 
convent ional ly  identified  causes  of  cost  growth  are  nothing 
more  than  symptoms  of  more  critical  problems  in  the  acquisi¬ 
tion  process  itself  (5:24).  To  better  understand  the  impact 
of  the  cost  growth  problem,  these  causes  can  be  related  to 
their  effect  on  different  contract  changes  which  occur  in 
the  acquisition  of  a  typical  weapon  system. 

Contract  Type 

The  heart  of  the  acquisition  process  is  the  written 
contract  between  industry  and  the  government  for  the  devel¬ 
opment  of  a  weapon  system.  The  contract  specifies  what  work 
is  to  be  performed  for  what  remuneration.  Contracts  can  be 
categorized  into  the  two  broad  areas  of  cost  contracts  and 
fixed  price  contracts.  Under  cost  type  contracts,  the 
government  reimburses  the  contractor  those  costs  which  are 
authorized  by  a  contracting  officer  as  being  allowable. 

Such  a  contract  is  usually  employed  on  projects  with  a  high 
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degree  of  technical  risk  and  uncertainty.  Fixed  price 
contracts  establish  a  firm  price  agreement,  and  the  govern¬ 
ment  is  not  liable  for  any  additional  cost.  This  type  of 
contract  is  used  when  there  is  little  performance,  cost,  or 
schedule  uncertainty  (9:23). 

Contracts  may  also  be  classified  as  either  a 
completion  or  a  term  contract.  With  a  completion  contract, 
the  contractor  is  required  to  deliver  a  specified  end  prod¬ 
uct.  A  completion  contract  is  usually  of  fixed  price  type. 

A  term  contract  requires  only  that  a  specified  time  length 
of  effort  is  applied,  utilizing  certain  skill  levels  and 
facilities.  In  other  words,  a  contractor  is  only  legally 
accountable  for  applying  a  "best  effort"  to  accomplish  the 
objectives  of  the  contract.  Term  contracts  are  generally  of 
cost  reimbursement  type  (9:19-20). 

Contracts  may  also  be  modified  to  include  incentive 
provisions.  Many  incentive  contracts  are  set  up  in  an 
effort  to  contain  cost  growth  (9:21).  One  study  prepared 
for  the  United  States  Army  Procurement  Research  office 
analyzed  the  average  cost  growth  per  contract  type  for  103 
major  Army  programs.  The  study  found  an  average  of  52.7% 
cost  growth  on  firm  fixed  price  contracts,  10.9%  cost 
growth  on  fixed  price  incentive  contracts,  117.5%  cost 
growth  on  cost  plus  incentive  fee  contracts,  and  50.2%  cost 
growth  on  cost  plus  fixed  fee  contracts.  Common  causes  for 
cost  growth  among  the  different  contract  types  included 


quantity  changes  and  engineering  change  proposals  (18:126— 
127)  . 

The  use  of  incentives  must  be  scrutinized  to  ensure 
they  are  not  counterproductive.  Concern  exists  that  the  DOD 
has  numerous  contract  incentives,  all  developed  in  isola¬ 
tion,  which  are  not  always  understood  nor  congruous.  These 
include  des ig n- to-cost  goals,  reliability  incentives,  award 
fees,  potential  quality  incentives,  and  cost-plus  incentive 
contracts.  Until  guidance  is  issued  on  the  systematic  use 
and  interrelationship  of  incentives,  discretion  must  be 
exercised  (11:22) . 

One  innovation  to  the  procedure  of  administering 
contracts  that  is  gaining  in  popularity  is  the  concept  of 
multiyear  procurement.  In  multiyear  procurement,  instead 
of  individually  funding  contracts  for  only  one  years'  pro¬ 
duction  requirements,  several  years  of  production  quantities 
are  funded  by  a  single  contract.  By  following  such  a  prac¬ 
tice,  the  government  can  capitalize  on  cost  savings  inherent 
in  buying  in  large  quantities.  Also,  defense  contractors, 
upon  recognizing  the  commitment  of  the  government,  are  more 
inclined  to  make  capital  investments  that  reduce  long  range 
costs  and  strengthen  the  industrial  base  (17:23-25).  As 
should  now  be  apparent,  the  type  of  defense  contract  select¬ 
ed  provides  much  latitude  for  potential  cost  control. 

Contract  composition  is  also  being  reviewed  as  a 
channel  for  reducing  costs.  This  is  evidenced  by  the 
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Streamlining  Initiative,  authorized  by  the  Deputy  Secretary 
of  Defense  in  January  1934.  The  purpose  of  this  initiative 
is  to  avoid  costly  and  unnecessary  requirements  sometimes 
imposed  by  defense  contracts  (13:7).  Savings  can  then  be 
realized  by  the  elimination  of  untailored  and  accidentally 
referenced  application  of  military  standards  and/or  specifi¬ 
cations.  Also,  contracts  should  specify  results  required 
rather  than  listing  detailed  procedures.  The  basic  premise 
behind  the  streamlining  initiative  is  that  the  cost-effec¬ 
tive  application  of  requirements  should  be  an  integral  part 
of  the  design  and  development  process  (10:6-9).  A  reduc¬ 
tion  in  unnecessary  and  counterproductive  requirements 
should  result  in  reduced  costs  and  lower  cost  overruns. 

An  even  more  encompassing  approach  to  reducing  costs 
involving  defense  contracts  entails  improving  the  productiv¬ 
ity  of  the  acquisition  environment.  This  was  the  thrust  of 
the  Acquisition  Improvement  Program,  authorized  by  then 
Deputy  Secretary  of  Defense  Frank  Carlucci  in  April  1931 
(3:81).  The  program  identified  32  initiatives  designed  to 
shorten  and  simplify  the  acquisition  process,  and  to  con¬ 
trol  costs.  Over  the  years,  the  Carlucci  initiatives  have 
undergone  change,  and  former  Deputy  Secretary  of  Defense 
Paul  Thayer  decided  to  place  priority  on  the  six  management 
areas  that  provided  the  greatest  potential  payback.  These 
areas  included  program  stability,  multiyear  procurement, 
economic  production  rates,  realistic  budgeting,  support  and 
readiness,  and  competition  (11:16). 


Contract  Schedule  and  Price 


Another  aspect  of  weapon  systems  acquisition 
influential  in  altering  costs  is  that  of  changes  to  contract 
prices  and  schedules.  Due  to  the  nature  of  research  and 
development  activity,  any  delay  in  overall  contract  schedule 
usually  results  in  increased  costs.  These  costs  derive 
from  "...rising  overhead  expenses  and  from  failure  of 
producers  to  utilize  optimally  their  productive  facilities" 
(3:83).  Another  view  states  that  due  to  outside  pressures,  a 
manager  must  often  proceed  with  full  commitment  to  a  project 
on  the  basis  of  partial  information.  As  such,  unforseeable 
conditions  inevitably  occur  which  result  in  schedule  delays 
(15:38,41) . 

Price  changes  in  contracts  also  have  a  direct  impact 
on  weapon  system  cost.  Many  diverse  causes  can  necessitate 
price  changes,  such  as  drastic  changes  in  the  economy. 

During  the  1973's  and  1983's  the  United  States  economy  often 
fluctuated,  as  reflected  by  major  variations  in  the  prices 
of  oil  and  gold.  To  accomodate  such  changes,  most  defense 
contracts  now  include  escalation  adjustment  clauses,  which 
allow  economic  conditions  to  influence  costs.  Price  changes 
may  also  occur  due  to  variance  in  a  defense  contractor's 
workload  structure.  If  other  projects  the  contractor  is 
working  are  unexpectedly  cancelled,  overhead  rates  on  all 
contracts  may  be  increased  (15:42-43) .  Such  arguments 


System  Design 

The  design  of  a  weapon  system  is  the  vehicle  which 
transforms  a  mission  need  into  an  operational  system.  Since 
all  work  is  planned  to  implement  a  particular  design,  any 
changes  in  that  design  mean  increases  in  cost.  Proper 
design  work  is  crucial  to  controlling  post-acquisition 
costs,  since  operation  and  support  costs  typically  double 
those  of  acquiring  the  system.  To  contain  these  costs,  life 
cycle  cost  considerations  must  be  integrated  early  in  the 
system  design  phase  (7:36). 

Even  with  careful,  detailed  attention  and  planning  for 
system  design,  technical  risk  can  at  best  only  be  reduced 
(3:41).  Through  a  combination  of  rapid  technological  ad¬ 
vancement  and  political  pressures,  design  changes  are  bound 
to  occur  at  some  point  in  system  development.  In  addition, 
one  must  be  alert  for  the  addition  of  unrealistic  or  unnec¬ 
essary  requirements,  or  "gold-plating"  (15:3,43).  One 
viable  alternative  for  minimizing  design  change  is  prototype 
fabrication  and  testing,  which  allows  the  buyer  to  test  a 
design  before  fully  committing  to  it  (13:122). 


A  related  aspect  of  weapon  system  acquisition  that 
affects  design  is  program  stability.  Many  factors  can 
contribute  to  an  acquisition  program's  instability,  such  as 
irregular  funding,  poorly  defined  requirements,  political 
issues,  changes  in  military  guidance,  and  changes  in  the 
enemy  threat  (  4  :  31 ; 16  : 19)  .  Any  of  these  factors  can  neces- 
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sitate  a  change  in  system  design.  One  recommended  proce¬ 
dure  for  improving  program  stability  is  program  baselining. 

A  program  baseline  is  a  thorough  description  of  a  weapon 
system  program  in  terms  of  technical  performance,  schedule, 
and  logistics  requirements,  as  agreed  upon  by  all  partici¬ 
pants  in  the  acquisition  process  (16:15).  Other  activities 
to  insure  program  stability  include  anticipation  of  future 
needs,  careful  planning  and  program  definition,  and  appro¬ 
priate  contracting  techniques  (15:45). 

A  system  design  must  also  incorporate  the  state  of 
available  manufacturing  technology,  if  production  costs  are 
to  be  minimized.  This  principle  is  reflected  in  the  concept 
of  the  manufacturing  yield.  A  manufacturing  yield  is  de¬ 
fined  as  the  ratio  of  the  number  of  acceptable  items  pro¬ 
duced  the  first  time  through  a  process  to  the  number  that 
entered  production  (12:13).  If  this  ratio  is  too  low, 
financial  loss  will  occur  through  scrap  and  rework  costs. 

To  reduce  these  costs  requires  a  stable  design  and  the 
application  of  adequate  manufacturing  process  controls. 

Research  has  documented  the  poor  manufacturing  yields 
and  high  rates  of  rework  at  some  'J .  S .  defense  production 
plants.  A  1932  study  of  aerospace  productivity  revealed  that 
retest  and  rework  sometimes  consume  up  to  4J  percent  of  a 
plant's  productive  capacity  (12:11)  .  Another  study  found 
that  yields  during  some  defense  production  start-ups  are  as 
low  as  5  to  13  percent.  Such  research  further  highlights 
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the  need  for  current  manufacturing  technology  to  be  incorpo¬ 
rated  into  stable  system  design. 


S  nmrna  r  y 

This  section  has  illustrated  that  the  problem  of  cost 
growth  in  weapon  system  acquisition  can  afflict  the  vast 
majority  of  defense  programs,  in  many  ways.  Of  the  numerous 
explanations  of  the  causes  for  cost  growth  that  have  been 
offered,  the  majority  involve  changes  in  contract  type, 
schedules,  prices  or  system  design.  Suggestions  to  improve 
cost  control  include  the  use  of  multiyear  procurement,  and 
increasing  program  stability.  Though  possible  solutions 
abound,  there  appears  to  be  no  universal  panacea  to  the 
problem  of  cost  growth,  possibly  due  to  the  complexity  of 
its  causes.  Continued  analysis  and  application  of  validated 
improvements  to  the  acquisition  process  may  be  the  only  true 
method  of  reducing  cost  growth. 


III.  Methodolo 


This  chapter  presents  the  methodology  that  was  pursued 
to  answer  the  research  and  investigative  questions  proposed 
in  Chapter  I  of  tnis  study.  The  data  source,  data  collec¬ 
tion  plan,  and  statistical  tests  which  were  used  to  analyze 
the  data  are  described. 

Data  Source 

The  LANTIRN  program  office  is  in  the  Deputy  for 
Reconnaissance,  Strike,  and  Electronic  Warfare  Division  of 
Aeronautical  Systems  Division,  located  at  Wright-  Patterson 
AFB.  All  contractual  data  on  the  program  were  maintained 
by  the  contracts  functional  office  of  the  LANTIRN  SPO, 
identified  by  the  office  symbol  RWNK .  The  LANTIRN  Full 
Scale  Engineering  Development  ( FSED)  contract  (assigned 
Contract  #F33657-80-C-0441)  was  issued  by  RWNK  on  September 
19,  1980,  with  the  Martin-Marietta  Corporation  of  Orlando, 
Florida  serving  as  the  prime  contractor.  The  contract 
consisted  of  both  firm  fixed  price  and  cost  plus  compo¬ 
nents.  Following  contract  award,  Martin-Marietta  experi¬ 
enced  difficulties  in  subcontractor  management ,  and  also 
encountered  major  technical  problems  which  resulted  in 
substantial  cost  growth  and  schedule  slippages.  In  June 
1981,  the  Air  Force  directed  Mar t in-Mar ietta  to  prepare  a 
restructured  F3D  proposal  incorporating  risk  reduction 
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efforts,  and  trade-offs  to  achieve  minimum  cost.  On  Febru¬ 
ary  2,  1983  a  complete  restructure  of  the  LANTIRN  FSED 
contract  was  incorporated.  For  purposes  of  this  study,  only 
contract  changes  executed  after  the  program  restructure  are 
considered  relevant. 

All  changes  to  the  LANTIRN  contract  are  documented  on 
an  AFSC  form  702  -  Amendment  of  Solicitation/Modification  of 
Contract.  All  contract  modification  documentation  is 
maintained  by  the  ASD  contract  files  office  (office  symbol 
ASD/PMAS,  Bldg  11),  with  copies  held  by  RWNK . 


Data  Collection  plan 


The  data  were  collected  by  performing  a  record 
analysis,  a  form  of  nonbehavior al  observation  (8:176).  Upon 
approval  of  the  study  by  the  RWNK  office  chief,  data  col¬ 
lection  was  begun  by  reviewing  copies  of  all  AFSC  form  702s 
available  subsequent  to  the  program  restructure.  Any  con¬ 
tract  modifications  not  available  through  the  RWNK  office 
were  obtained  from  the  ASD  contract  files  office.  The 
LANTIRN  FSED  contract  had  not  reached  full  completion  at  the 
time  of  this  study,  therefore  only  contract  modifications 
which  had  received  final  approval  prior  to  December  31,  1985 
are  included  as  data. 

To  facilitate  data  analysis,  the  contract 
modifications  were  grouped  into  four  broad  categories.  A 
listing  of  these  categories  and  their  requisite  criteria  are 
recorded  in  Table  3.1. 
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TABLE  3.1 


CLassiE ications  of  Contract  Modifications 


Category  _I  -  Statement  of  Work  (SOW)  changes.  No  Delivery 
Impact 

Criteria:  Additions/Changes  to  SOW  (Section  J  of 
contract)  documented  on  AFSC  form  702,  no  other  modifica¬ 
tions 


Samples:  New  work  in  form  of  Studies,  Analyses,  etc. 


Category  1 1  -  Sow  changes,  Delivery  Impact 

Criteria:  SOW  change  documented  on  AFSC  form  702, 
change  to  a  non-data  end  item  delivery  date  documented  on 
AFSC  form  706,  Supplies  Schedule  Data 

Samples:  Design  changes.  Engineering  Change  Proposals 
( ECP)  ,  etc  . 


Category  III  -  SOW  changes.  New  Deliverables 

Criteria:  SOW  changes  documented  on  AFSC  form  702,  new 
line  items  documented  on  AFSC  form  705,  Supplies  Line  Item 
Data,  and  delivery  dates  established  for  new  deliverables  on 
AFSC  form  706,  Supplies  Schedule  Data 

Samples:  New  work  resulting  in  new  hardware  or 
software  deliverables 


Category  IV  -  Contract  changes,  No  SOW  impact 


Criteria:  Change  to  some  section 
affecting  SOW,  documented  by  AFSC  form 


of  contract  not 
702 


Samples:  Deviations/Wa iver s ,  GFE  repair,  etc. 
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For  each  contract  change,  additional  data  recordings 
were  also  made.  This  information  includes  the  cost  of  the 
change,  the  date  of  the  change  proposal,  the  final  approval 
date  of  the  change,  the  page  quantity  of  the  SOW  involved 
(if  applicable),  the  period  of  performance  proposed  for  the 
change,  and  other  miscellaneous  data.  Contract  changes 
implemented  to  incrementally  fund  the  contract,  administra¬ 
tive  changes,  and  changes  involving  the  classified  HAVE 
LIGHT  program  were  excluded  from  study.  In  addition,  all 
cost  figures  involved  were  adjusted  to  1986  dollars  ^-ref¬ 
erence  appendices  A-E) . 

Table  3.2  provides  the  specific  variables  to  be 
analyzed  for  each  investigative  question.  Each  variable 
will  be  ultimately  related  to  changes  in  contract  cost. 


TABLE  3.2 


Data  Analysis  Used  to  Answer  Research  Questions 


Research 

Question 

Variables 

Analysis 

la 

In-scope  vs.  out  of  scope  changes 

MANN- WHITNEY 

lb 

Page  quantity  of  Sow  changes  vs.  cost 

KRUSKAL- 

WALLI3 

lc 

Cost  plus  vs.  fixed  price  changes 

MANN-WHITNEY 

2a 

Change  order  vs.  supplemental  agrmt 

MANN- WHITNEY 

2b 

Change  order  vs.  supplemental  agrmt 
involving  Sow  change 

MANUAL 

2c 

Time  spans  elapsed  to  definitize 
a  change  order  vs.  cost 

KRUSKAL- 

WALLIS 

2d 

Receipt  of  cost  proposal  vs.  final 
approval  date 

KRUSKAL- 

WALLIS 

2e 

NTE  vs.  final  change  order  cost 

MANN-WHITNEY 

2  f 

Point  in  time  of  contract  change 
vs.  cost 

KRUSKAL- 
W ALL IS 

2g 

Changes  before  vs.  after  CDR 

MANUAL 

3a 

Delivery  schedule  additions  and  delays 
vs.  other  changes 

MANN-WHITNEY 

3b 

Delivery  schedule  additions  and  delays 
vs.  other  changes  involving  SOW 
mod i f icat ions 

MANN-WHITNEY 

4a 

ECP  page  length  vs.  cost 

KRUSKAL- 
W ALL IS 

4b 

Length  of  period  of  performance 
vs.  cost 

MANN-WHITNEY 

V'.- '  ‘"Vk Y''_"V 


-r  .--v-  „-v>> 


The  SPSSx  subroutines  MANN- WHITNEY  and  KRUSKAL-WALLIS 
were  employed  for  initial  data  analysis.  These  subroutines 
perform  nonparametr ic  tests  which  determine  whether  or  not 
there  are  differences  in  true  averages  among  two  or  more 
populations.  Whenever  sample  sizes  are  small,  or  popula¬ 
tions  may  not  be  normally  distributed,  nonpar ametr ic  sta¬ 
tistical  procedures  which  do  not  require  assumptions  about 
the  shapes  of  underlying  distributions  are  appropriate. 

The  factor  under  study,  which  is  the  cost  of  contract  chang¬ 
es  expressed  in  dollars,  serves  as  the  dependent  variable. 
The  different  populations,  or  levels  of  the  factor,  are  the 
independent  variables.  Data  employed  in  this  study  satisfy 
the  analysis  requirement  that  the  dependent  variable  must  be 
expressed  as  at  least  ordinal  level  data,  and  that  the  inde¬ 
pendent  variable  must  be  expressed  as  at  least  nominal 
level  data. 

The  following  hypothesis  was  tested: 

tj  :  There  is  no  difference  in  the  costs  of  contract 
changes  among  the  populations  of  the  independent  variable 
(sample  means  are  equal) 

9a:  There  is  a  statistically  significant  difference 
in  the  costs  of  contract  changes  among  the  different  popula¬ 
tions  (at  least  two  of  the  sample  means  are  not  equal) 

The  MANN- WHITNEY  subroutine  first  combined  and  ranked 
the  observations  for  both  samples  from  smallest  to  largest. 
The  statistic  for  testing  the  hypothesis  that  the  two  dis- 
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tri'outions  are  equal  is  the  sum  of  the  ranks  for  each  of  the 
two  groups.  If  the  two  groups  have  the  same  distribution, 
their  sample  distribution  of  ranks  should  be  similar. 

Scores  from  the  test  are  transformed  to  a  standard  normal 
deviate  (Z) ,  and  a  probability  level  is  computed.  If  the  Z 
probability  statistic  was  less  than  the  0.05  level  of  sig¬ 
nificance,  the  null  hypothesis  was  rejected.  Rejection  of 
the  null  hypothesis  indicated  that  a  statistically  signifi¬ 
cant  difference  existed  among  the  contract  change  cost  means 
for  the  two  populations. 

The  KRUSKAL-WALLIS  subroutine  performs  a  procedure 
similar  to  that  used  in  the  Mann-Whitney  test,  and  was  used 
for  analysis  involving  more  than  two  groups.  All  the  cases 
from  the  groups  were  combined  and  ranked,  with  average  ranks 
being  assigned  in  the  case  of  ties.  For  each  group,  the 
ranks  were  summed,  and  the  Kruskal-Wallis  H  statistic  was 
computed  from  these  sums.  The  H  statistic  has  approximately 
a  chi-square  distribution  under  the  hypothesis  that  the 
subject  groups  have  the  same  distribution.  If  the  chi- 
square  probability  statistics  was  less  than  the  0.05  level 
of  significance,  the  null  hypothesis  was  rejected.  Rejec¬ 
tion  of  the  null  hypothesis  would  indicate  that  a  statisti¬ 
cally  significant  difference  existed  among  the  contract 
change  cost  means  for  the  subject  groups.  Multiple  compari¬ 
sons  analysis  would  then  be  requir'd  to  determine  which 
groups  differ  significantly  from  one  another 
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I V  .  Find  ings  and  Analysis 

This  chapter  presents  the  descriptive  statistics  and 
analysis  for  the  data  collected  from  the  LANTIRN  contract 
files.  Each  of  the  13  investigative  questions  is  analyzed 
separately.  Hypotheses  that  were  tested  are  identified  in 
conjunction  with  the  statistical  procedure  used  to  test  the 
hypothesis.  The  findings  are  expanded  to  include  inferences 
that  could  have  important  implications  for  acquisition 
management,  even  though  they  cannot  be  explicitly  supported 
by  statistical  analysis. 

Presentation  of  Findings 

Invest igat  ive  Question  la 

Was  there  a  significant  cost  difference  between 
changes  within  the  scope  or  outside  the  scope  of  the 
contract? 

For  this  investigative  question,  contract  changes  were 
grouped  into  the  categories  of  either  being  within  the  scope 
or  outside  of  the  scope  of  the  contract.  If  there  was  no 
Statement  of  Work  (SOW)  addition  or  change,  then  the  con¬ 
tract  change  was  considered  within  the  scope  of  the  contract 
(Group  1) .  If  the  contract  modification  involved  an  addi¬ 
tion  or  change  to  the  SOW  (Section  J  of  the  contract)  as 
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documented  by  AFSC  form  702,  then  the  contract  change  was 
considered  outside  of  the  scope  of  the  contract  (Group  2)  . 


TABLE  4.1 

Descriptive  Statistics  for  Investigative  Question  la 


Group 

Count 

Mean 

Cost 

Standard 
Dev i at  ion 

Standard  95  Pet  Conf  Int 

Error  for  Mean 

Grp  1 

25 

1334 

3694 

739 

-441  to  2633 

Grp  2 

12 

10873466 

21743560 

6276325 

-2941730  to 

24688663 

Total 

37 

3527262 

13079942 

2150329 

-333808  to  7388331 

Group 

Minimum 

Max imum 

Cost 

Cost 

Grp  1 

3 

17870 

Grp  2 

230984 

69167130 

Total 

3 

69157133 

A  MANN 

-WHITNEY 

test  was 

conducted  on  this  population 

of  contract 

changes , 

with  the 

type  of  contract  change  as  the 

i ndependen  t 

variable 

and  the  cost  of  the 

contract  change  as 

the  dependent  variable.  Contract  changes 

were  classified  as 
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being  either  within  the  scope  or  outside  of  the  scope  of  the 
contract.  Results  of  the  test  are  displayed  in  Table  4.2. 


TABLE  4.2 

MANN- WHITNEY  Test  Results  for  Investigative  Question  la 


Mean 

Cost 

Rank 

Cases 

Group 

Corrected  for  Ties 
Z  2-Tailed  P 

1084 

13.00 

25 

Inscope 

-5.3827  0.0000 

10373466 

31.50 

12 

Outscope 

The  following  null  hypothesis  was  tested: 

H0:  There  is  no  difference  in  the  mean  cost  of 

contract  changes  among  changes  within  the  scope  or  outside 

of  the  scope  of  the  contract. 

Ha:  There  is  a  statistically  significant  difference 

in  the  mean  cost  of  contract  changes  among  changes  within 
the  scope  or  outside  of  the  scope  of  the  contract. 

The  null  hypothesis  was  rejected  for  the  subject 
population  of  contract  changes  at  a  significance  level  of 
0.350.  This  research  concludes  that  for  the  LANTIRN  FSED 
contract,  whether  a  contract  modification  was  considered 
within  the  scope  or  outside  of  the  scope  of  the  contract 
played  a  major  role  in  the  magnitude  of  cost  addition  to  the 


contract.  The  relatively  large  sample  sizes,  very  small  p- 
value,  and  extreme  difference  in  the  mean  costs  tend  to 
reinforce  this  view.  Of  the  37  contract  changes  recorded, 
approximately  32%  were  changes  considered  outside  of  the 
scope  of  the  contract.  The  high  mean  cost  for  these  con¬ 
tract  modifications  accounts  for  a  large  portion  of  the  cost 
increase  in  the  LANTIRN  FSED  contract. 

Invest igat ive  Question  lb 

Did  the  page  quantity  of  a  statement  of  work  (SOW) 

have  any  correlation  with  cost? 

This  investigative  question  involved  only  contract 
changes  which  contained  SOW  changes  or  additions.  Specifi¬ 
cally,  the  contract  changes  were  categorized  by  the  length 
of  the  SOW  additions.  The  first  category  contains  SOW 
additions  under  3  pages  in  length  (Group  1) .  Next  are  SOW 
additions  between  3-5  pages  in  length  (Group  2) .  The  final 
category  contains  SOW  changes  over  5  pages  in  length  (Group 
3).  SOW  changes  and  additions  were  identified  by  modifica¬ 
tion  to  Section  J  of  the  contract,  as  documented  by  AFSC 


TABLE  4.3 

Descriptive  Statistics  for  Investigative  Question  lb 


Mean  Standard  Standard  95  Pet  Conf  Int 
Group  Count  Cost  Deviation  Error  for  Mean 


Grp 

1 

3 

719327 

1043038 

605114 

-1884296 

3322951 

to 

Grp 

2 

6 

217338 

3042335 

1242028 

-1019348 

53660024 

to 

Grp 

3 

3 

37362382 

34226926 

19760925 

-47662949  to 
122387713 

Total 

12 

10607096 

21865395 

6311996 

-3235511 

to 

24499703 


Group 


Minimum 

Cost 


Maximum 

Cost- 


Grp  1 
Grp  2 
Grp  3 
Total 


230934 

1141923 

0 


1921352 

7934135 

69167180 

69157130 


the  subject  3< 
the  accompany 


those  SOWs  under  3  pages  in  length,  between  3-5  pages,  and 


over  5  pages  in  length.  Results  of  the  test  are  displayed 
in  Table  4.4. 


TABLE  4.4 

KRUSKAL-WALLI3  Test  Results  for  Investigative  Question  lb 


Mean 

Cost 

Rank 

Cases 

Corrected  for  Ties 
Group  Chi-Square  Significance 

719327 

4.00 

3 

3  pages  4.3846  3.111 

2173338 

6.30 

6 

3-5  pages 

37362382 

10.00 

3 

over  5  pages 

The  following  null  hypothesis  was  tested: 

There  is  no  difference  in  the  mean  cost  of 
contractchanges  involving  SOWs  of  differing  page  quantities. 

Ha :  There  is  a  statistically  significant 

difference  in  mean  cost  of  contract  changes  involving  SOWs 
of  differing  page  quantities. 

The  null  hypothesis  was  not  rejected  for  this 
population  of  contract  changes  at  a  significance  level  of 
3.J50.  This  researcn  concludes  that  for  the  LANTIRN  FSED 
contract  there  was  no  significant  difference  among  the  cost 
of  contract  changes  involving  SOWs  of  different  page 
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lengths.  A  review  of  mean  costs  for  the  three  groups  does, 
however,  show  a  steady  increase  as  the  length  of  the  SOWs 
increase.  The  small  sample  sizes  involved  and  the  variabil¬ 
ity  in  the  data  could  account  for  the  lack  of  statistical 
significance  in  the  results.  Therefore  the  page  length  of  a 
SOW  for  a  contract  modification  may  indeed  be  correlated 
with  the  cost  of  the  contract  change,  the  relationship  being 
that  the  greater  the  length  of  the  SOW,  the  greater  the  cost 
of  the  contract  modif ication. 


Invest igat ive  Question  lc 

Was  contract  type  a  factor  in  the  cost  of  changes? 

The  LANTIRN  Full  Scale  Development  ( FSD)  contract  is 
structured  such  that  it  contains  both  firm  fixed  price  and 
cost  plus  components  for  the  various  work  efforts.  This 
investigative  question  categorizes  contract  changes  by  the 
type  of  contract  involved.  Group  1  contains  contract  changes 
which  affect  the  cost  plus  component  of  the  contract,  and 
Group  2  contains  contract  changes  which  affect  the  fixed 
price  component  of  the  contract. 


TABLE  4.5 


Descriptive  Statistics  for  Investigative  Question  lc 


Group 

Count 

Mean  Standard  Standard 
Cost  Deviation  Error 

95  Pet  Conf  Int 
for  Mean 

Grp  1 

3 

1610134  412844 

233355 

584562  to  2635706 

Grp  2 

25 

6019419  15593954 

3113790 

-417443  to 

12456287 

Total 

23 

5546996  14767997 

2790839 

-179435  to 

11273427 

Group 

Minimum 

Cost 

Maximum 

Cost 

Grp  1 

1141923 

1921852 

Grp  2 

1567 

69167130 

Total 

1567 

69167130 

A  MANN- 

WHITNEY  test  was 

conducted  on 

the  relevant 

contract  changes,  with  the  type  of  contract  to  which  the 
change  was  made  as  the  independent  variable  and  the  cost  of 
the  contract  change  as  the  dependent  variable.  Contract 
changes  were  classified  as  to  whether  they  modified  the  firm 
fixed  price  or  the  cost  plus  component  of  the  LANTIRN  con¬ 
tract.  Results  of  the  test  are  recorded  in  Table  4.6. 
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TABLE  4.6 


MANN-WHITNEY  Test  Results  for  Investigative  Question  lc 


Mean 

Cost 

Rank 

Cases 

Corrected 
Group  Z 

for  Ties 
2-Tailed  P 

1610134 

16.67 

3 

Cost-Plus  -0.6734 

0.6291 

6019419 

14.24 

25 

Fixed-Pr ice 

The  following  null  hypothesis  was  tested: 

H0:  There  is  no  difference  in  the  mean  cost  of 

contract  changes  between  those  changes  affiliated  with  the 

fixed-price  component  of  the  contract  and  the  cost-plus 
component . 

Hd:  There  is  a  statistically  significant 

difference  in  the  mean  cost  of  contract  changes  between 
those  changes  affiliated  with  the  fixed-price  component 

The  null  hypothesis  was  not  rejected  for  the  involved 
groups  of  contract  changes  at  a  significance  level  of  0.050. 
This  research  concludes  that  for  the  LANTIRN  FSED  contract 
there  was  no  significant  difference  in  the  mean  contract 
change  cost  for  changes  to  either  the  firm-fixed  price  or 
cost-plus  components  of  the  contract.  In  review  of  the 
data,  it  is  noted  that  there  were  only  three  cases  of  chang¬ 
es  to  the  cost-plus  component  of  the  contract,  as  opposed  to 
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25  cases  for  the  firm-fixed  price  component.  The  small 
sample  size  for  the  cost-plus  contract  changes  may  have 
resulted  in  a  more  deflated  significance  value  than  if  the 
sample  size  were  closer  to  that  encountered  with  the  firm- 
fixed  price  contract  changes.  Also,  the  mean  contract 
change  cost  for  the  fixed-price  changes  is  approximately  4.4 
million  dollars  greater  than  that  for  the  cost-plus  changes. 
Thus,  the  greatest  number  of  contract  changes  were  to  the 
component  of  the  contract  (fixed-price)  which  had  the  high¬ 
est  mean  contract  change  cost.  Although  not  statistically 
different,  the  data  suggest  that  changes  to  the  firm-fixed 
price  component  of  the  contract  are  more  costly  on  average 
than  changes  to  the  cost-plus  contract  component. 

Invest igat ive  Quest  ion  2a 

Is  there  a  significant  cost  difference  between  change 

orders  and  supplemental  agreements? 

This  investigative  question  categorizes  contract 
changes  by  the  process  used  to  formalize  the  change.  If  a 
contractor  is  given  authorization  to  begin  a  new  work  effort 
prior  to  the  cost  of  the  effort  being  fully  negotiated 
(based  on  a  not- to-exceed  estimate),  this  action  is  known  as 
a  change  order.  A  final  cost  for  the  change  order  is  then 
negotiated  at  a  later  date  and  incorporated  as  a  supplemen¬ 
tal  agreement.  If  the  cost  of  a  new  work  effort  is  fully 
negotiated  prior  to  the  contractor  beginning  the  actual 
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work,  then  the  modification  is  referred  to  as  a  supplemen¬ 
tal  agreement.  Group  1  contains  contract  changes  author¬ 
ized  by  change  order  and  Group  2  contains  contract  changes 
authorized  by  supplemental  agreement. 


TABLE  4 .7 

Descriptive  Statistics  for  Investigative  Question  2a 


Group 

Count 

Mean 

Cost 

Standard 

Deviation 

Standard 

Error 

95  Pet  Conf  Int 
for  Mean 

Grp  1 

10 

3678170 

21383441 

6763619 

-5622191  to 

23978531 

Grp  2 

28 

396 

3495 

660 

-459  to  2251 

Total 

33 

2284339 

11236993 

1822382 

-1409120  to  5977899 

Group 

Minimum 

Cost 

Maximum 

Cost 

Grp  1 

200984 

69167180 

Grp  2 

0 

17870 

Total 

0 

69167130 

A  MANN- WHITNEY  test  was  performed  on  the  contract 
modifications  with  the  type  of  contract  change  as  the  inde¬ 
pendent  variable  and  the  cost  of  the  contract  change  as  the 
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dependent  variable.  Contract  changes  were  grouped  by  the 
process  used  to  formalize  the  change,  the  two  processes 
being  change  orders  and  supplemental  agreements.  For  change 
orders  the  final,  fully  negotiated  supplemental  agreement 
cost  is  utilized  and  not  the  not- to-exceed  (NTE)  estimate. 
Results  of  the  test  are  displayed  in  Table  4.8. 

TABLE  4.3 

MANN-WHITNEY  Test  Results  for  Investigative  Question  2a 


Mean 

Cost 

Rank 

Cases 

Corrected 
Group  Z  2 

for  Ties 
-Tailed  P 

8678169 

33.50 

10 

Change  Orders  -5.3649 

0 .0000 

396 

14.50 

28 

Supp  Agreements 

The  following  null  hypothesis  was  tested: 


ri0:  Thera  is 

contract  changes  among 


no  difference  in  the  mean  cost 
change  orders  and  supplemental 


me  n  t  s . 


of 

agree- 


d i f  f erence 
orders  and 


There  is  a  statistically  significant 
in  the  mean  cost  of  contract  changes  among 
supplemental  agreements. 


change 


The  null  hypothesis  was  rejected  for  the  involved 
groups  of  contract  changes  at  3  significance  level  of  3.050. 


This  research  concludes  that  for  the  LANTIRN  FSED  contract 


there  was  a  significant  difference  between  the  mean  cost  of 
change  orders  and  supplemental  agreements,  with  change 
orders  being  much  more  costly.  Change  orders  also  comprised 
the  majority  of  contract  changes  involving  changes  to  the 
SOW  (out-of  scope  changes) ,  and  consequently  the  more  major 
work  efforts.  Out-of-scope  changes  had  previously  been 
demonstrated  to  be  more  costly  than  in-scope  changes  (refer¬ 
ence  investigative  question  la).  Many  of  the  same  contract 
changes  which  were  included  in  the  out-of  the  scope  of  the 
contract  category  also  reappear  in  the  change  order  category 
(reference  appendices  G  and  J) .  It  must  also  be  noted  that 
many  of  the  supplemental  agreement  contract  changes  were 
within  the  scope  of  the  contract  and  were  executed  at  no 
cost  to  the  government  (reference  appendix  j) . 


Inves t iga t ive  Question  2 b 


Is  there  a  significant  cost  difference  between  change 
orders  and  supplemental  agreements  involving  SOW  changes? 


Contract  change  classifications  for  this  investigative 
question  were  limited  to  those  contract  changes  involving 
additions  or  changes  to  the  contract  SOW.  These  changes 
were  then  further  subdivided  by  whether  they  were  authorized 
by  change  order  or  supplemental  agreement.  Group  1  contains 
SOW  contract  changes  authorized  by  change  order  and  Group  2 


contains  SOW  contract  changes  authorized  by  supplemental 
agreement . 


TABLE  4 .9 

Descriptive  Statistics  for  Investigative  Question  2b 


Group 

Mean 
Count  Cost 

Standard 

Deviation 

Standard 
Er  ror 

9  5  Pet 
for 

Conf 

Me  a  n 

Int 

Grp 

1 

13  8678169 

2138441 

5763619 

-6622191 

to 

23978531 

Grp 

2 

1  3 

3 

3 

3 

to 

3 

Group 

Min imum 
Cost 

Maximum 

Cost 

or  •>  x 

203934 

69167130 

Grp  2 

3 

3 

Total 

3 

69167180 

Review  of  the  LANTIRN  FSED  contract  files  revealed 
that  all  contract  modifications  involving  SOW  changes  were 
accomplished  by  change  order.  As  such,  no  comparisons  could 
be  made  between  supplemental  agreements  and  change  orders 
which  both  involved  SOW  changes.  Investigative  Question  la 
has  previously  demonstrated  that  contract  modifications 
involving  SOW  cnanges  (out-of-scope)  are  significantly  more 


costly  than  changes  within  the  scope  of  the  contract. 
Investigative  Question  2a  demonstrated  that  change  orders 
are  on  average  more  costly  than  supplemental  agreements. 
Without  supplemental  agreements  involving  SOW  changes  avail¬ 
able  for  comparison,  the  exact  relationship  between  change 
orders,  out-of-scope  contract  changes,  and  in-scope  contract 
changes  cannot  be  determined .  Specifically,  it  cannot  be 
determined  whether  out-of  scope  changes  are  more  costly  than 
in-scope  changes  because  they  involve  SOW  alterations, 
because  they  were  implemented  by  change  order,  or  because 
of  some  combination  of  the  two. 

Investigative  Question  2c 

Is  there  a  significant  cost  difference  among  change 

orders  which  required  differing  time  spans  for  defin- 

itzation? 

After  a  change  order  is  authorized,  a  final  cost  for 
the  work  effort  involved  must  be  negotiated  and  incorporated 
as  a  supplemental  agreement.  This  investigative  question 
examines  the  period  of  time  elapsed  between  author i za t ion  of 
a  change  order  and  incorporation  of  a  fully  negotiated  cost 
via  supplemental  agreement.  Group  1  contains  change  orders 
fully  negotiated  in  under  5  months.  Group  2  contains  change 
orders  fully  negotiated  within  5-6  months,  and  Group  3 
contains  change  orders  fully  negotiated  in  excess  of  6 
month  s . 
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TABLE  4.10 


Descriptive  Statistics  for  Investigative  Question  2c 


Mean 

Standard 

Standard 

9  5  Pet 

Conf  Int 

Group  Count  Cost 

Deviation 

Error 

for 

Mean 

Grp  1 

2 

213557 

24852 

17573 

Grp  2 

3 

2051203 

980376 

566021 

Grp  3 

4 

2437334 

3709304 

1354502 

Total 

9 

1815549 

2500168 

833389 

Group 

Minimum 

Cost 

Maximum 

Cost 

Grp  1 

200934 

236130 

Grp  2 

1141923 

3089834 

Grp  3 

303197 

7984135 

Total 

200984 

7934135 

-4729  to  441343 

-334214  to 
4436620 

-3464464  to 
3339071 

-10629  to 
3737346 


A  KRUSKAL-WALLI S  test  was  conducted  on  the  change 
order  population,  with  the  time  span  required  for  change 
order  def initization  serving  as  the  independent  variable 
and  the  cost  of  the  change  order  (contract  change)  as  the 
dependent  variable.  The  change  orders  were  grouped  as  re- 


quiring  either  under  5  months,  between  5-6  months,  or  over  6 
months  for  final  cost  negotiation  and  agreement.  Results  of 
the  test  are  displayed  in  Table  4.11. 


TABLE  4.11 

KRUSKAL-WALLIS  Test  Results  for  Investigative  Question  2c 


Mean 

Cost 

Rank 

Corrected 

Cases  Group  Chi-Square 

for  Ties 
Significance 

213557 

1.50 

2 

under  5  mo's 

4.9000 

0.0863 

2051203 

7.00 

3 

5-6  months 

2437304 

5.25 

4 

over  6  mo's 

The  following  null  hypothesis  was  tested: 

H0:  There  is  no  difference  between  the  mean  cost 

of  contract  changes  involving  change  orders  with  differing 
time  spans  required  for  def initization . 

Ha:  There  is  a  statistically  significant  difference 

in  the  mean  cost  of  contract  changes  involving  change  orders 
with  differing  time  spans  required  for  def initization. 

The  null  hypothesis  was  not  rejected  for  the  three 
groupings  of  change  orders  at  a  significance  level  of  0.050. 
This  research  concludes  that  for  the  LANTIRN  FSED  contract, 
there  is  no  significant  difference  between  the  contract 
change  costs  for  change  orders  which  required  differing  time 


spans  for  def initization.  The  significance  level  achieved, 
however,  may  be  understated  due  to  the  small  sample  sizes 
involved.  Further  supporting  evidence  is  provided  by  the 
magnitude  of  difference  in  means  between  Group  1  and  Groups 
2  and  3  (Reference  Table  5.5).  Thus  the  possibility  exists 
that  there  may  be  correlation  between  cost  and  the  length  of 
time  required  for  change  order  def initization,  with  the 
trend  being  that  the  greater  the  cost,  the  greater  the 
length  of  time  needed  to  definitize  the  change. 


Invest igat ive  Question  2d 


Is  there  a  significant  cost  difference  between 


contract  changes  with  differing  time  spans  for  receipt  of 
the  cost  proposal  and  the  final  approval  date? 


Prior  to  the  initiation  of  new  work,  the  SPO  must 
receive  some  type  of  cost  estimate  from  the  contractor 
before  final  authorization  can  be  given.  This  investigative 
question  examines  the  length  of  time  elapsed  between  receipt 
of  a  cost  proposal  from  the  contractor  and  approval  from  the 
SPO  to  initiate  the  work  effort  (either  by  change  order  or 
supplemental  agreement) .  Group  1  contains  contract  changes 
which  required  less  than  3  months  to  negotiate;  Group  2 
contains  contract  changes  which  required  between  3-5  months 
to  negotiate;  and  Group  3  contains  contract  changes  which 
required  more  than  5  months  to  negotiate. 


TABLE  4 .12 


Descriptive  Statistics  for  Investigative  Question  2d 


Group 

Mean 

Count  Cost 

Standard 

Deviation 

Standard 

Error 

95  Pet  Conf  Int 
for  Mean 

Grp  1 

3 

23763339 

39330293 

22737355 

-73939599  to 
121466276 

Grp  2 

4 

540712 

413978 

236989 

-118010  to 

1199433 

Grp  3 

4 

3812672 

2962345 

1431172 

-901011  to 

8526355 

Total 

11 

3363959 

23392359 

6148678 

-5636146  to 

21764064 

Group 

Minimum 

Cost 

Maximum 

Cost 

Grp  1 

200934 

69167180 

Grp  2 

236130 

1141923 

Grp  3 

980236 

7984185 

A  KRUSKAL-WALLIS  test  was  performed  on  the  relevant 
population  of  contract  changes,  with  contract  changes  in¬ 
volving  cost  proposals  as  the  independent  variable  and  the 
cost  of  the  contract  change  as  the  dependent  variable. 
Contract  changes  involving  cost  proposals  were  grouped  by 
those  requiring  under  3  months,  between  3-5  months,  or  over 
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5  months  to  obtain  final  approval.  Results  of  the  test  are 
displayed  in  Table  4.13. 


TABLE  4.13 

KRUSKAL-WALLIS  Test  Results  for  Investigative  Question  2d 


Mean 

Cost 

Rank 

Cases 

Group 

Corrected 

Chi-Square 

for  Ties 
Signi f icance 

23763339 

6.33 

3 

3  months 

3.3258 

0.1896 

540712 

3.75 

4 

3-5  months 

3812672 

8.00 

4 

over  5  months 

The  following  null  hypothesis  was  tested: 

H  :  There  is  no  difference  in  the  mean  cost  of 

contract  changes  involving  cost  proposals  with  differing 
time  spans  for  receipt  of  the  cost  proposal  and  the  final 
approval  date. 

Ha:  There  is  a  statistically  significant 

difference  in  the  mean  cost  of  contract  changes  involving 
cost  proposals  with  differing  time  spans  for  receipt  of  the 
cost  proposal  and  the  final  approval  date. 

The  null  hypothesis  was  not  rejected  for  the  subject 
group  of  contract  changes  at  a  significance  level  of  0.0 50. 
This  research  concludes  that  for  the  LANTIRN  FSED  contract 


there  was  no  significant  difference  in  the  mean  contract 
change  cost  for  changes  involving  cost  proposals  with  dif¬ 
fering  time  spans  to  obtain  final  approval.  The  small 
sample  sizes  involved  may  be  a  contributing  factor  to  the 
achieved  level  of  significance.  Even  with  small  sample 
sizes  taken  into  account,  there  does  not  appear  to  be  corre¬ 
lation  between  time  spans  for  cost  proposal  final  approval 
and  cost. 

Investigative  Question  2e 

Is  there  a  significant  difference  between  the  Not-To- 
Exceed  (NTE)  estimates  and  the  final  negotiated  price 
of  change  orders? 

Change  orders  are  issued  based  on  a  not- to-exceed 
estimate  (NTE),  in  lieu  of  a  fully  negotiated  cost  proposal. 
At  some  later  date,  a  complete  cost  proposal  for  the  work 
effort  must  be  negotiated  and  formalized  as  a  supplemental 
agreement.  The  final  cost  for  the  work  effort  may  not 
exceed  the  NTE;  however,  a  lower  cost  can  be  negotiated. 

For  this  investigative  question,  contract  changes  imple¬ 
mented  by  change  order  are  grouped  and  examined.  Group  1 
contains  the  NTE  costs  for  the  change  orders  and  Group  2 
contains  the  final  negotiated  supplemental  agreement  cost. 


TABLE  4.14 


Descriptive  Statistics  for  Investigative  Question  2e 


Group 

Count 

Mean 

Cost 

Standard 

Deviation 

Standard  95 
Error 

Pet  Conf 
for  Mean 

int 

Grp  1 

9 

2415937 

3449066 

1149355 

-234479 

5066352 

to 

Grp  2 

9 

1315549 

2500168 

833389 

-106243 

3737346 

to 

Total 

18 

2115743 

2933007 

692495 

654736 

3576779 

to 

Group 

Minimum 

Cost 

Maximum 

Cost 

Grp  1 

293144 

11187518 

Grp  2 

233984 

7984135 

Total 

230984 

11137513 

A  MAMN-WHITNEY  test  was  performed  on  the  population  of 
change  orders,  with  the  stage  of  the  change  order  as  the 
independent  variable  and  the  cost  of  the  contract  change  as 
the  dependent  variable.  The  change  orders  were  classified 
by  their  NTS ' s  and  final  negotiated  prices.  Results  of  the 
test  are  displayed  in  Table  4.15. 
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TABLE  4.15 


MANN-WHITNEY  Test  Results  for  Investigative  Question  2e 


Mean  Corrected  for  Ties 

Cost  Rank  Cases  Group  Z  2-Tailed  P 


2415937  10.44  9  NTE  -0.7505  0.4529 

1315549  8.56  9  Final  Cost 


The  following  null  hypothesis  was  tested: 

^q*.  There  is  no  difference  in  the  mean  cost 

between  NTE  estimates  and  the  final  negotiated  price  for 
change  orders? 

Ha:  There  is  a  statistically  significant 

difference  in  the  mean  cost  between  NTE  estimates  and  the 

final  negotiated  price  for  change  orders. 

The  null  hypothesis  was  not  rejected  for  the  two 
stages  of  change  orders  at  a  significance  level  of  0.050. 
This  research  concludes  that  for  the  LANTIRN  FSED  contract 
there  was  no  significant  difference  in  the  mean  cost  of  NTE 
estimates  and  the  final  approved  cost  for  change  orders. 
This  finding  indicates  that  even  though  the  contractor 
delivers  a  NTE  estimate  prior  to  change  order  approval,  t h i 
"estimate"  will  likely  not  differ  significantly  from  the 


final  negotiated  cost. 


Since  a  contractor  will  typically, 


by  definition  of  a  NTE,  provide  a  very  conservative  cost 
estimate,  the  practice  of  issuing  change  orders  would  not 
appear  to  be  the  most  cost  efficient  method  for  implementing 
contract  changes. 


Investigative  Quest  ion  2f 

Is  there  a  relationship  between  the  point  of  tine  in 


contract  duration  at  which  the  change  occurs  and  cost? 


The  LANTIRN  FSED  contract  was  restructured  in  February 
1983,  and  data  for  this  study  was  collected  through  December 
1986.  For  this  investigative  question,  contract  changes  are 
grouped  by  the  fiscal  year  in  which  they  were  executed.  If 
a  contract  change  was  retroactive,  then  the  effective  date 
serves  as  the  date  of  execution.  Group  1  contains  contract 
changes  executed  in  1982;  Group  2  contains  contract  changes 
executed  in  1983;  Group  3  contains  contract  changes  executed 
in  1984;  and  Group  4  contains  contract  changes  which  were 


executed  in  1985 


TABLE  4.16 


Descriptive  Statistics  for  Investigative  Question  2f 


Group 

Count 

Mean 

Cost 

Standard 

Deviation 

Standard 

Error 

95  Pet  Conf  Int 
for  Mean 

Grp  1 

3 

139639 

328464 

139639 

-626320  to 
1005597 

Grp  2 

15 

5345392 

17755949 

4584566 

-3987525  to 
15678308 

Grp  3 

19 

395343 

1921164 

440745 

-30624  to  1821319 

Grp  4 

7 

6712959 

15509347 

5861982 

-7630718  to 
21356636 

Total 

44 

3460275 

12046613 

1816096 

-202231  to 

7122782 

Group 

Minimum 

Cost 

Maximum 

Cost 

Grp  1 

0 

568916 

Grp  2 

0 

69167180 

Grp  3 

0 

7984135 

Grp  4 

0 

41778043 

Total 

0 

69167130 

A  KRUSKAL-WALLIS  test  was  conducted  on  the  population 
of  contract  changes,  with  the  fiscal  year  the  change  oc¬ 
curred  as  the  independent  variable  and  the  cost  of  the 
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contract  change  as  the  dependent  variable.  Contract  changes 
were  grouped  by  whether  they  were  effective  in  fiscal  year 
1982,  1983,  1984  or  1985.  Results  of  the  test  are  displayed 
in  Table  4.17. 


TABLE  4.17 

KRUSKAL-WALLIS  Test  Results  for  Investigative  Question  2f 


Mean 

Cost 

Rank 

Cases 

Group 

Corrected 

Chi-Square 

for  Ties 
Significance 

189639 

17.00 

3 

1982 

0.375 

0.8313 

5845392 

23.47 

15 

1983 

895348 

21.95 

19 

1984 

6712959 

24.29 

7 

1935 

The  following  null  hypothesis  was  tested: 

There  is  no  difference  in  the  mean  cost  of 
contract  changes  which  occurred  in  different  fiscal  years. 

Ha:  There  is  a  statistically  significant 

difference  in  mean  cost  of  contract  changes  which  occurred 

in  different  fiscal  years. 


The  null  hypothesis  was  not  rejected  for  the 
population  of  contract  changes  at  a  significance  level  of 
0.050.  This  research  concludes  that  for  the  LANTIRN  FSED 


contract,  there  is  no  significant  difference  in  the  mean 
cost  of  contract  changes  which  were  approved  in  different 
fiscal  years.  The  effects  of  inflation  were  accounted  for 
by  the  conversion  of  all  costs  to  a  FY1936  base  (reference 
appendices  B,C,D,  and  E) .  This  finding  tends  to  reinforce 
the  research  design  that  all  contract  changes  recorded  were 
from  the  same  stage  ( FSED)  of  the  LANTIRN  contract,  since 
traditionally  contract  changes  become  more  costly  as  a 
program  progresses  through  different  stages  of  the  acquisi¬ 
tion  cycle. 

Investigative  Question  2g 

Is  there  a  difference  between  contract  change  costs 
which  occur  before  or  after  the  Critical  Design 
Review? 

The  purpose  of  this  investigative  question  was  to 
group  contract  changes  by  whether  they  occurred  before  or 
after  the  System  Critical  Design  Review  (CDR) .  The  CDR  for 
the  LANTIRN  navigation  pod  occurred  during  December  1931  and 
the  CDR  for  the  LANTIRN  targeting  pod  occurred  during  April 
1982  (19).  All  contract  changes  for  the  restructured 
LANTIRN  FSED  program  occurred  after  these  dates.  No  fur¬ 
ther  analysis  was  performed  for  this  investigative  question. 
Since  there  were  no  contract  changes  prior  to  the  CDR  for 
the  restructured  LANTIRN  FSED  contract,  it  will  not  be 
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possible  to  determine  any  cost  effect  that  changes  after  the 
CDR  may  have  yielded. 


Investigative  Quest  ion  3a 

Does  the  establishment  of  new  hardware/ software 
deliverables  and  schedule  delays  impact  cost  versus 
other  contract  changes? 

This  investigative  question  groups  contract  changes  by 
whether  the  change  affects  the  delivery  date  of  an  existing 
contract  line  item  or  establishes  a  new  contract  line  item. 

A  contract  change  was  classified  as  having  a  delivery  impact 
if  there  was  a  change  to  an  end  item  delivery  date  document¬ 
ed  on  an  AFSC  form  706,  Supplies  Schedule  Data,  or  if  a  new 
contract  line  item  was  established  as  documented  on  an  AFSC 
form  70S,  Supplies  Line  Item  Data.  Group  1  contains  con¬ 
tract  changes  which  had  a  delivery  impact,  and  Group  2 
contains  contract  changes  which  did  not  have  a  delivery 
impac  t . 
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TABLE  4.13 


Descriptive  Statistics  for  Investigative  Question  3a 


Group 

Count 

Mean 

Cost 

Standard 

Deviation 

Standard 
Er  ror 

95  Pet 
for 

Con  f 
Mean 

Int 

Grp  1 

13 

12526963 

23660438 

7432373 

-4398668  to 
29452588 

Grp  2 

33 

174636 

613331 

1119313 

-54262 

to 

403535 

Total 

40 

3262717 

12631975 

1992547 

-767593 

to 

7293024 

Group 

Minimum 

Cost 

Maximum 

Cost 

Grp  1 

0 

69167180 

Grp  2 

0 

3389334 

Total 

3 

69167183 

A  MANN-vJHITNEY  test  was  conducted  on  the  contract 
changes,  with  the  type  of  contract  change  as  the  independent 
variable  and  the  cost  of  the  contract  change  as  the  depend¬ 
ent  variable.  Contract  changes  were  classified  as  to  wheth¬ 
er  or  not  they  had  an  impact  on  the  contract  delivery  sched¬ 
ule.  Results  of  the  test  are  displayed  in  Table  4.19. 


MANN-WHITNEY  Test  Results  for  Investigative  Question  3a 


Corrected  for  Ties 

Mean  Rank  Cases  Group  Z  2-Tailed  P 


12526960 

32.35 

10 

Delivery  -4.1796 

0 .0000 

174636 

15.55 

30 

Nondelivery 

The  following  null  hypothesis  was  tested: 

h  :  There  is  no  difference  in  the  mean  cost  of 

no 

contract  changes  that  have  or  do  not  have  delivery  schedule 
impact . 


^a:  There  is  a  statistically  significant 

difference  among  the  mean  cost  of  contract  changes  that 


have,  or  do  not  have,  delivery  schedule  impact. 


The  null  hypothesis  was  rejected  for  the  identified 
groups  of  contract  changes  at  a  significance  level  of  3.050. 
This  research  concludes  that  for  the  LANTIRN  FSED  contract 
there  is  a  statistically  significant  difference  in  the  mean 
cost  of  contract  changes  which  have  a  delivery  impact  versus 
those  that  do  not  have  a  delivery  impact..  The  magnitude  of 
tne  difference  in  means  for  the  two  groups  suggests  that 
either  the  delay  of  an  existing  contract  line  item  (CLIN), 
or  the  establishment  of  a  new  contract  line  item,  or  both 


factors  combined  can  have  a  major  impact  on  the  cost  of  a 
contract.  The  contract  change  category  involving  delivery 
impacts  was  not  farther  subdivided  to  investigate  these 
issues  due  to  the  small  sample  sizes  involved. 

Investigative  Question  3b 

Does  the  establishment  of  new  hardware/software 
deliverables  and  schedule  delays  significantly  impact 
cost  versus  other  contract  changes  involving  SOW 
changes? 

For  this  investigative  question,  the  population  under 
study  is  limited  to  those  contract  changes  which  affect  the 
SOW  as  documented  by  AFSC  form  702.  These  contact  changes 
are  then  grouped  by  whether  or  not  they  had  a  delivery 
impact,  using  the  same  criteria  as  stated  in  investigative 
question  3a.  Group  1  contains  contract  changes  which  had 
both  SOW  and  delivery  impact,  and  Group  2  contains  contract 
changes  which  just  had  SOW  impact. 
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TABLE  4.20 


Descriptive  Statistics  for  Investigative  Question  3b 


Group 

Count 

Mean 

Cost 

Standard 

Deviation 

Standard 

Error 

95  Pet  Conf  Int 
for  Mean 

Grp  1 

13 

12526950 

23660403 

7482078 

-4398663  to 
2*452588 

Grp  2 

5 

1709432 

1442603 

645154 

-81774  to  3500637 

Total 

15 

892117 

19706275 

5083138 

-1991354  to 
19834088 

Group 

Mi  nimum 

Maximum 

Cost 

Cost 

Grp  1 

0 

69167180 

Grp  2 

0 

3335166 

Total 

0 

69167180 

A  MANN- WHITNEY  test  was  conducted  on  the  subject 
groups  of  contract  changes,  with  the  type  of  contract  change 
as  the  independent  variable  and  the  cost  of  the  contract 
change  as  the  dependent  variable.  Contract  changes  were 
classified  as  either  having  a  delivery  schedule  impact,  or 
not  having  a  delivery  schedule  impact  but  containing  SOW 
changes.  Results  of  the  test  are  displayed  in  Table  4.21. 


TABLE  4.21 


MANN-WHITNEY  Test  Results  for  Investigative  Question  3b 


Mean 

Cost 

Rank 

Cases 

Group 

Corrected  for  Ties 
Z  2-Tailed  P 

12526960 

3.15 

10 

Delivery 

-0.1839  0.8541 

1709432 

7.70 

5 

Other  SOW 

The  following  null  hypothesis  was  tested: 

H0:  There  is  no  difference  in  the  mean  cost  of 

contract  changes  having  delivery  schedule  impact  versus 
other  SOW  contract  changes. 

Ha:  There  is  a  stat istically  significant 

difference  in  the  mean  cost  of  contract  changes  having 
delivery  schedule  impact  versus  other  SOW  contract  changes. 

The  null  hypothesis  was  not  rejected  for  the  subject 
groups  of  contract  changes  at  a  significance  level  of  3.050. 
This  research  concludes  that  for  the  LANTIRN  FSED  contract, 
there  is  no  significant  difference  in  the  mean  contract 
change  cost  between  changes  impacting  the  delivery  schedule 
and  other  changes  containing  SOW  impact.  Of  the  15  contract 
changes  recorded  involving  SOW  changes,  10  of  these  had 
delivery  schedule  impact  while  the  other  5  did  not.  The 
differences  encountered  in  sample  sizes  may  have  slightly 


altered  the  observed  significance  level.  Even  so,  it  appears 


that  the  factor  of  whether  a  contract  change  altered  the  SOW 


had  greater  cost  implications  than  if  a  delivery  schedule 


impact  was  solely  involved. 


Investigative  Question  4a 


Was  the  page  quantity  of  an  engineering  change 


proposal  a  factor  which  affected  cost? 


Cost  proposals  for  contract  changes  are  often  received 


in  the  form  of  engineering  cost  proposals  (ECPs) .  This 


investigative  question  groups  contract  changes  by  the  page 


length  of  the  ECP  which  precipitated  the  change.  Group  1 


contains  contract  changes  whose  corresponding  ECPs  were 


under  23  pages  in  length,  and  Group  2  contains  contract 


changes  whose  corresponding  ECPs  are  greater  than  23  pages 


in  length. 


TABLE  4.22 


Descriptive  Statistics  for  Investigative  Question  4a 


Group 

Mean 
Count  Cost 

Standard 

Deviation 

Standard 

Error 

95  Pet  Conf  Int 
for  Mean 

Grp  1 

6 

1186574 

1166485 

476216 

-37558  to  2410707 

Grp  2 

5 

16316821 

29696566 

13280708 

-20555737  to 
53139379 

Total 

11 

8063959 

20392359 

6148678 

-5635146  to 
21764064 

Group 

Minimum 

Cost 

Maximum 

Cost 

Grp  1 

236130 

3196434 

Grp  2 

230984 

69157130 

Total 

200984 

69167180 

A  MANN- WHITNEY  test  was  performed  on  the  population  of 
contract  changes  involving  engineering  change  proposals 
( ECP ) ,  with  the  page  quantity  of  the  ECP  as  the  independent 
variable  and  the  cost  of  the  contract  change  as  the  depend¬ 
ent  variable.  The  contract  changes  were  grouped  by  whether 
the  involved  ECP  was  less  than  or  greater  than  23  pages  in 
length.  Results  of  the  test  are  displayed  in  Table  4.23. 


TABLE  4.23 


MANN- WHITNEY  Test  Results  for  Investigative  Question  4a 


Mean 

Cost 

Rank 

Cases 

Group 

Corrected  for  Ties 
Z  2-Tailed  P 

1186574 

5.00 

6 

under  20  pgs 

-1.0954  0.2733 

16316821 

7.20 

0 

over  20  pgs 

The  following  null  hypothesis  was  tested: 

There  is  no  difference  in  the  mean  cost  of 
contract  changes  containing  ECPs  of  under  or  over  20  pages 

in  length. 

Ha:  There  is  a  statistically  significant 

difference  in  the  mean  cost  of  contract  changes  containing 
ECPs  of  under  or  over  20  pages  in  length. 

The  null  hypothesis  was  not  rejected  for  the  subject 
groups  of  contract  changes  at  a  significance  level  of  0.050. 
This  research  concludes  that  for  the  LANTIRN  FSED  contract, 
there  is  no  significant  difference  in  the  mean  cost  of 
contract  changes  containing  ECPs  of  under,  or  over  20,  pages 
in  length.  To  answer  the  investigative  question,  only  two 
groups  of  ECP  page  lengths  were  established  (under  20  pages 
or  over  20  pages),  to  allow  for  similar  sample  sizes.  If 
larger  sample  sizes  were  available,  it  would  have  been 
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preferable  to  further  subdivide  the  ECP  page  length  catego¬ 
ries  to  potentially  identify  any  trends  which  may  not  have 
been  evident  through  the  use  of  only  two  categories. 

Investigat ive  Question  4b 

Has  there  a  significant  cost  difference  between  the 
lengths  of  the  periods  of  performance  for  a  contract 
change? 

Contract  changes  which  involve  the  addition  of  new 
work  often  specify  a  period  of  performance  for  which  the 
work  is  to  be  performed.  This  investigative  question  groups 
contract  changes  by  the  length  of  the  period  of  performance 
involved.  Group  1  contains  contract  changes  with  less  than 
10  months  specified  as  the  period  of  performance;  Group  2 
contains  contract  changes  with  between  10-25  months  speci¬ 
fied  as  the  period  of  performance;  Group  3  contains  contract 
changes  with  greater  than  25  months  specified  as  the  period 
of  performance. 


TABLE  4.24 


I 


Descriptive  Statistics 


for 


Investigative  Question  4b 


Group 

Mean 
Count  Cost 

Standard  Standard 
Deviation  Error 

95  Pet  Conf  Int 
for  Mean 

Grp  1 

5 

745797 

774872  346534 

-215313  to  1737913 

Grp  2 

5 

3232440 

2745299  1227735 

-176243  to  6641124 

Grp  3 

3 

24281737 

38895628  22456401 

-72341420  to 
120904894 

Total 

13 

7133569 

18754064  5231442 

-4199397  to 

13466536 

Group 

Minimum  Maximum 

Cost  Cost 

Grp  1 

203984 

2038441 

Grp  2 

1141923 

7984135 

Grp  3 

481596 

69167183 

Total 

203934 

69157130 

A  KRUSKAL-WALLIS  test  was  performed  on  contract 
changes  specifying  a  period  of  performance,  with  the  length 
of  the  period  of  performance  as  the  independent  variable  and 
the  cost  of  the  contract  change  as  the  dependent  variable. 
Contract  changes  were  grouped  uy  whether  they  specified 
under  13  months,  between  13-25  months,  or  over  25  months  as 
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the  period  of  performance.  Results  of  the  test  are  dis¬ 
played  in  Table  4.25. 


TABLE  4.25 

KRUSKAL-WALL I S  Test  Results  for  Investigative  Question  4b 


Mean 

Cost 

Rank 

Cases 

Corrected  for  Ties 
Group  Chi-Square  Significance 

745798 

3.80 

5 

under  10  months  5.5239  0.0633 

3232440 

8.80 

5 

10-25  months 

24281737 

9.33 

3 

over  25  months 

The  following  null  hypothesis  was  tested: 

There  is  no  difference  in  the  mean  cost  of 
contract  changes  specifying  differing  lengths  for  the  period 
of  performance. 

Ha:  There  is  a  statistically  significant 

difference  in  the  mean  cost  of  contract  changes  which  speci¬ 
fy  differing  lengths  for  the  period  of  performance. 

The  null  hypothesis  was  not  rejected  for  the  involved 
groups  of  contract  changes  at  a  significance  level  of  3.050. 
This  research  concludes  that  for  the  LANTIRN  FSED  contract, 
there  is  no  statistically  significant  difference  in  the  mean 
cost  of  contract  changes  which  specify  differing  lengths  for 


the  period  of  performance.  It  must  be  noted  that  the  ob¬ 
served  significance  level  (3.3633)  was  close  to  the  thresh¬ 
old  value  required  to  achieve  significance  (3.053).  With 
the  small  sample  sizes  taken  into  account,  it  would  be 
reasonable  to  suggest  that  there  may  indeed  be  a  significant 
difference  among  the  mean  contract  change  costs  for  two  or 
more  of  the  groups  of  contract  changes  containing  different 
periods  of  performance.  As  the  length  of  the  period  of 
performance  increased,  the  mean  contract  change  cost  was 
also  observed  to  increase  (reference  Table  5.12).  If  this 
finding  was  validated,  it  would  imply  that  by  decreasing  the 
period  of  performance  for  a  contract  change  to  the  minimum 
length  feasible,  cost  savings  could  possibly  ensue. 
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VI . 


Conclusions  and  Recommendations 


This  chapter  contains  the  conclusions  that  can  be 
drawn  from  this  analysis  of  the  contract  modifications 
executed  during  the  FSED  stage  of  the  LANTIRN  contract. 
Practical  implications  that  can  be  drawn  and  limitations  on 
applicability  will  be  discussed.  Recommendations  are  pro¬ 
vided  for  follow-on  studies  to  further  investigate  means  of 
increasing  the  cost  effectiveness  of  acquisition  management. 

Conclusions 

The  data  analysis  used  to  answer  the  13  investigative 
questions  provided  the  basis  for  drawing  specific  conclu¬ 
sions.  Other  inferences  were  made  based  on  the  quantities 
and  types  of  contract  changes  observed  through  review  of  the 
LANTIRN  contract  files. 

A  total  of  47  non-administrative  contract 
modifications  were  recorded  to  have  been  executed  prior  to 
December  31,  1985  on  the  LANTIRN  FSED  contract.  Some  con¬ 
tract  modifications  had  been  initiated  prior  to  the  stated 
date  but  had  not  yet  received  final  approval,  and  thus  were 
not  included  in  the  study.  Where  change  orders  were  in¬ 
volved,  one  supplemental  agreement  was  executed  which  con¬ 
firmed  the  NTE  price  and  a  follow-on  supplemental  agreement 
was  executed  reflecting  the  final,  negotiated  price.  Unless 
otherwise  indicated,  the  final  negotiated  price  was  used  in 

data  analysis  for  all  change  orders. 

67 


.  *-  *v  *.  \ 


The  conclusions  of  this  research  are  summarized  below. 


1.  Contract  changes  which  affected  the  Statement  of 
Work  had  a  pronounced  cost  impact  on  the  contract.  The  cost 
of  a  contract  change  affecting  the  SOW  was  on  average  sever¬ 
al  magnitudes  greater  than  that  of  a  contract  change  within 
the  scope  of  the  contract.  Of  all  variables  analyzed, 
whether  or  not  the  change  affected  the  SOW  was  the  most 
consistent  predictor  of  the  cost  magnitude  of  the  change. 

The  page  quantity  of  the  SOW  change  was  not  observed  to  have 
any  correlation  with  the  cost  of  the  change.  Also,  there 
was  no  significant  difference  in  the  cost  of  SOW  changes 
which  affected  either  the  cost-plus  or  the  fixed-price 
component  of  the  contract. 

These  findings  suggest  that  a  prime  method  of 
limiting  cost  growth  to  a  contract  would  be  to  minimize  the 
number  of  out-of-scope  contract  changes.  This  implies  that 
greater  care  should  be  exercised  in  preparing  the  initial 
contract  SOW  to  ensure  that  all  known  requirements  are 
considered.  After  this  determination,  a  program  baseline 
should  be  developed  such  that  all  technical  requirements  are 
frozen,  which  would  enhance  program  stability.  This  would 
enable  more  efficiency  in  the  estimation  and  allocation  of 
federal  funds  to  defense  programs. 

2.  Change  orders  added  significantly  to  the  cost  of 
the  contract,  as  opposed  to  supplemental  agreements.  The 
mean  cost  of  change  orders  was  on  average  several  magnitudes 
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greater  than  that  for  supplemental  agreements.  The  time 


span  required  to  fully  negotiate  a  change  order  also  may 


affect  its  cost,  with  the  relationship  being  that  the  great¬ 


er  the  time  required  for  negotiation,  the  greater  the  cost 


of  the  change.  These  findings  imply  that  change  orders 


should  be  avoided  when  possible  as  a  vehicle  for  implement¬ 


ing  contract  change,  in  the  interest  of  minimizing  cost 


growth , 


All  of  the  change  orders  recorded  involved  SOW 


changes.  No  comparison  could  be  drawn  between  change  orders 


and  other  supplemental  agreements  involving  SOW  changes. 


because  all  contract  modifications  involving  changes  to  the 


SOW  were  implemented  by  change  order.  Therefore  it  was  not 


possible  to  determine  for  SOW  contract  changes  if  there 


would  be  any  cost  difference  for  implementation  by  change 


order  or  supplemental  agreement 


There  was  also  found  to  be  no  significant  difference 


between  the  NTE  estimate  for  a  change  order,  and  the  final 


negotiated  price.  A  program  manager  should  therefore  pay 


close  attention  to  the  NTE  estimate  provided  by  the  contrac¬ 


tor  for  a  work  effort,  since  the  final  cost  will  likely  not 


deviate  significantly  from  this  estimate. 


The  period  of  time  required  to  negotiate  a 


supplemental  agreement  after  the  receipt  of  a  cost  proposal 


was  found  not  to  have  a  significant  correlation  with  cost. 


Also  regarding  time,  there  was  no  significant  difference  in 
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the  cost  of  contract  changes  which  were  executed  in  differ¬ 
ent  fiscal  years  (  after  accounting  for  the  effects  of 
inflation  ) .  This  finding  would  seem  to  suggest  that  the 
stage  of  contract  completion  had  no  effect  on  the  immediate 
cost  of  a  contract  change.  However,  it  must  be  noted  that 
all  of  the  contract  changes  reviewed  were  executed  after  the 
system  critical  design  review.  Therefore  even  though  the 
contract  changes  were  occurring  over  different  fiscal  years, 
they  were  also  occurring  during  roughly  the  same  develop¬ 
mental  stage  of  the  program.  Thus,  the  effects  of  contract 
changes  executed  over  different  developmental  stages  of  the 
program  could  not  be  evaluated. 

3.  Contract  changes  which  in  any  way  affected  the 
product  delivery  schedule  of  the  contract  had  a  significant¬ 
ly  higher  mean  cost  than  changes  which  did  not  affect  the 
delivery  schedule.  However  when  contract  changes  which 
impacted  the  product  delivery  schedule  were  compared  with 
other  contract  changes  which  affected  the  SOW,  there  was  no 
significant  cost  difference.  This  finding  implies  that 
whether  a  contract  change  impacts  the  SOW  has  greater  cost 
implications  than  if  the  delivery  schedule  is  affected  in 
addition.  Also,  if  the  SOW  is  not  affected  by  the  contract 
change,  then  delivery  schedule  changes  provide  a  greater 
cost  growth  than  non-delivery  schedule  contract  changes. 

Such  results  suggest  that  changes  to  the  product  delivery 
schedule  of  a  contract  will  likely  provide  for  some  degree 
of  cost  growth. 


4.  All  of  the  design  changes  recorded  involved 
changes  to  the  SOW  and  were  accompanied  by  engineering 
change  proposals  (ECP) .  No  correlation  was  found  between 
the  cost  of  the  design  change  and  the  page  length  of  the 
engineering  change  proposal.  A  tentative  connection  was 
found  between  contract  cost  and  the  length  of  the  period  of 
performance  established.  As  the  length  of  the  period  of 
performance  expanded,  the  greater  was  the  mean  contract 
cost.  Therefore  it  can  be  concluded  that  design  changes  can 
add  a  significant  contribution  to  the  cost  growth  of  a  con¬ 
tract  by  virtue  of  their  impact  to  the  SOW.  The  period  of 
performance  required  to  implement  the  design  change  should 
also  be  held  to  the  minimum  time  length  possible,  in  an 
attempt  to  minimize  cost  growth. 

Recommendations 

Presently  the  LANTIRN  program  is  in  the  production 
phase,  although  some  FSED  tasks  are  still  undergoing  comple¬ 
tion.  The  findings  of  this  research  suggest  that  further 
out-of-scope  contract  changes  could  have  major  cost  implica¬ 
tions,  particularly  at  this  phase  of  program  development. 
Additionally,  any  change  to  an  existing  FSED  task  could 
possibly  force  unplanned  out-of-scope  changes  to  the  produc¬ 
tion  program. 

If  for  unavoidable  reasons  a  change  is  deemed 
necessary,  it  is  recommended  that  change  orders  be  avoided 


as  a  means  of  implementing  the  change.  A  fully  priced  cost 
proposal  should  be  requested,  upon  which  a  supplemental 
agreement  can  be  negotiated.  If  use  of  a  change  order  is 
unavoidable,  effort  should  be  taken  to  reduce  the  amount  of 
time  required  between  approval  of  the  unpriced  order  and  the 
negotiation  of  a  final  price.  If  the  task  required  involves 
a  period  of  performance  to  complete,  it  is  recommended  that 
a  minimum  amount  of  time  be  pursued  for  task  completion. 
Changes  which  affect  existing  product  delivery  schedules 
must  also  be  avoided. 

This  study  represents  an  analysis  of  the  contract 
files  for  the  FSED  phase  of  the  LANTIRN  program.  As  such, 
all  conclusions  and  implications  that  have  been  drawn  are 
only  applicable  as  applied  to  that  particular  program. 
Further  research  should  be  conducted  to  analyze  the  effects 
of  contract  changes  on  cost  growth  for  other  acquisition 
programs.  In  this  manner,  more  cost-effective  policies  for 
acquisition  management  can  be  developed. 

Since  the  LANTIRN  program  was  managed  under  the 
Aeronautical  Systems  Division  (ASD) ,  it  is  recommended  that 
other  ASD  programs  be  studied  to  determine  if  similar  con¬ 
clusions  can  be  drawn.  If  trends  are  identified,  then 
similar  studies  should  be  conducted  on  programs  from  other 
product  divisions  to  determine  if  the  same  trends  exist. 

The  analysis  of  the  contract  files  of  the  LANTIRN 
program  was  only  for  the  FSED  stage  of  program  development. 
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Other  studies  should  examine  different  stages  of  acquisi¬ 
tion  programs  to  determine  if  the  causes  of  cost  growth  are 
in  any  way  connected  to  the  particular  stage  of  program 
development . 

In  selecting  candidate  SPOs  for  analysis, 
consideration  should  be  given  to  the  size  of  the  SPO  and  the 
quantity  of  contract  modifications  recorded.  Some  of  the 
analysis  performed  in  this  study  were  hampered  by  small 
sample  sizes.  By  selecting  a  major  weapon  system  program 
for  study,  a  greater  diversity  of  investigative  areas  can  be 
analyzed  with  an  improved  reliability  of  the  data. 
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Appendix  A:  Revised  OSD  Inflation  Rates 
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AIRCRAFT  PROCUREMENT 

(  3010 

OSD 

RACES 

mi; 

1956 

FISCAL 

BASE 

FEAR 

1976 

19  79 

I960 

1981 

1982 

19£3 

1984 

1555 

1386 

1979 

1.156 

1 . 066 

0.971 

0.868 

0.792 

0.727 

0.673 

0.646 

0.621 

1979 

1.277 

1.175 

1.071 

0.  957 

0.873 

0.801 

0.742 

0.713 

0.664 

1930 

1  _430 

1.316 

1.199 

1.072 

0.978 

0.897 

0.E31 

0.798 

0.766 

1961 

1.559 

1.434 

1.307 

1.168 

1.066 
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0.906 

0.870 

0.E36 

1962 

1.64  0 

1.506. 

1.375 

1.229 
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1.029 

0.952 

0.915 

0.  E79 

1953 
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1.313 

1.198 

1 .  059 

1. 01B 
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0.930 

1964 

1.646 
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1.262 

1 . 156 
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1.030 
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1955 

1.92S 
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1.445 

1.318 

1.209 
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1.076 

1.033 

1966 
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1.660 
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1.074 

1957 
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1.738 
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1.417 
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1.204 
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•>  Til 
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1.600 

1.459 
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1 .  2  74 

1  oco 
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1.302 
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1  “53 
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*  0 
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1QQ4 
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1.540 
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2.106 
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2.569 
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1.970 
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1.64  9 
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1.466 
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1995 
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2.473 
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1.6  =  7 
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Appendix  B: 


Conversion  of  FY82  Costs  to  FY85 


Conversion  Algorithm  =  FY32  cost/WTD  factor  FY82/RAW  factor 

FY8  6 


P000#  FY3  2  COST  FY3  6  COST 


39  0  0 

41  0  0 
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Appendix  C:  Conversion  of  FY83  Costs 

Conversion  Algorithm  =  FY83  cost/  WTD  factor 
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37 

64916580 

69167180 

s 

t 

47 

0 

0 

V1 

52 

0 

0 

A 

53 

452000 

481596 

V 

i 

54 

5132 

5521 

l 

*« 

57 

16772 

1737. 

I 

58 

0 

0 

ij 

59 

105000000 

11187513 

JfJ 

f 

6  9 

0 

0 

$ 

52 

0 

0 

« 

6  3 

0 

0 

S 

In 

66 

1500000 

1598217 

$ 

67 

1900000 

2024403 

.V 

v 

V 

6  8 

2000 

2131 

y 

V 

*• 

■  A 
♦  * 

v 

1 

\ 

I 

*. 

,V 

fit 

*» 

» 

* 

77 

i 

i 

.  .  . _  i 

V=-  V*  ■  .'V.'-'i 

Appendix  D 


Conversion  of  FY84  Costs  to  FY8 6 


Conversion  Algorithm  =  FY34  cost/  WTD  factor  FY84/RAW  factor 

FY86 


|  P000# 

FY84  COST 

FY86  COST 

73 

0 

0 

74 

0 

0 

75 

0 

0 

76 

0 

0 

77 

295000 

293144 

78 

1550 

1567 

i 

80 

7900000 

7984185 

82 

969900 

980236 

33 

0 

0 

35 

1129833 

1141923 

36 

233640 

236130 

89 

M 

350000 

353730 

94 

3300000 

3335166 

95 

0 

0 

99 

365000 

353890 

1210 

1987264 

20003441 

133 

300000 

303197 

78 

,?] 


Appendix  E 


Conversion  of  PY85  Costs  to  FY86 


Conversion  Algorithm  * 

FY35  cost/  WTD  factor 

FY85/RAW  factor 
FY36 

P000# 

FY3  5  COST 

FY8  6  COST 

112 

0 

0 

113 

207825 

200934 

116 

1987264 

1921852 

117 

3195000 

3089834 

120 

0 

0 

122 

43200000 

41773043 

130 

0 

0 

Appendix  F: 


LANTIRN  FSED  Contract  Modifications 


P000* 

TITLE 

DATE 

COST 

35 

Restructure/Restart 

2/16/83 

133535610 

36 

NERC  Detector 

1/11/83 

3000000 

37 

SE  Price  Increase 

12/22/33 

64916580 

39 

Revise  DD254 

8/27/82 

0 

41 

Competitive  Fly-Off 

9/22/82 

0 

43 

ARPANET  Sys  Upgrade 

9/27/32 

5000000 (NTE) 

47 

SE  Special  Provision 

12/17/32 

0 

52 

Devi at ion/Wa ivers 

4/12/83 

0 

53 

Defin  of  C/0  P00043 

3/28/83 

452000 

54 

Repair  of  GFE 

3/29/33 

5132 

56 

Incorp  of  Updated  CDRL 

1/31/34 

0 

57 

Repair  of  GFP 

3/29/33 

16772 

53 

Incorp  Rev  Sec  Guide 

3/29/83 

0 

59 

Block  I  Retrofit  Demo 
and  Target  Recognizer 
and  Extension 

5/31/83 

13500000 (NTE) 

60 

Rev  Sec  Class  Guide 

4/13/33 

0 

62 

Incorp  of  Dev/Waivers 

9/21/83 

0 

63 

Incorp  of  Revised  Specs 
for  Container  Shipping 

5/16/33 

0 

66 

Change  in  SOW,  LaNTIRN 
Auto  Terrain 

7/1/83 

1500000 (NTE) 

67 

LANTIRN  installed  Sys 
Perform  Responsibility 

8/25/83 

1900000 (NTE) 

POOO# 


TITLE 


DATE 


COST 


63 

Mod  of  GFP 

7/29/33 

2000 

73 

Incorp  of  Dev/Waivers 

12/9/83 

0 

74 

Change  in  Inspection, 
Acceptance,  and  Delivery 
Location 

11/4/83 

0 

75 

Incorp  of  Dev/Waivers 
and  add  GFP 

12/9/33 

0 

76 

Special  Termination 

Cost  Clause 

10/31/83 

0 

77 

Mod  of  Structural 
Verification  Vehicle 

Pods 

10/31/83 

295000 (NTE) 

78 

Replace  GFP 

11/22/33 

1550 

30 

Defin  of  C/0  P00059 

12/27/83 

6152000{FP) 

1748000(CP) 

82 

Defin  of  C/0  P00066 

12/20/33 

969900 

33 

Incorp  of  Dev/Waivers 
and  add  GFP 

1/25/84 

0 

35 

Defin  C/0  P00067 

2/16/34 

1129833 

86 

Defin  of  C/0  P00077 

3/30/34 

233640 

89 

JOVIAL  Upgrade  C/0 

3/29/34 

350000 (NTE) 

94 

Manufacturing  Risk/ 
Reduction  in  FCS 

7/25/84 

3300000 (NTE) 

95 

Target  Recognizer  Effort 

5/31/34 

0 

99 

EOCM  Testing 

7/6/84 

365000 (NTE) 

100 

LANTIRN/F-15E  Integratio 
and  ICWG 

n 

7/6/84 

1987264 (NTE) 

101 

Add  and  Modify  GFP 

7/23/34 

0 

103 

Dev/Waivers,  delete  GFP 

8/21/84 

3 

POOO# 

TITLE 

DATE 

COST 

107 

Dev/Waivers ,add  GFP 

3 

138 

Defin  of  C/0  P00039 

9/23/84 

303033 

112 

Revised  Acceptance  and 
Testing  Program 

2/6/85 

0 

113 

Defin  of  C/O  P00099 

12/12/34 

237825 

116 

Defin  of  C/0  POOO130 

12/21/84 

1937264 (CP) 

117 

Defin  of  C/0  P 0009 4 

1/15/85 

3195000 

120 

Deviations/Waivers 

4/10/35 

0 

122 

Prime  Mission  Hardware 
Tasks  and  Restructure 
of  3E 

3/27/85 

43230030 (NTE) 

130 

DD254  Revision 

11/19/35 

3 

GROUP  1  (IN-SCOPE) 


GROUP  2  (OUT-OF-SCOPE) 


POOO# 

FY86  COST 

POOO# 

FY8  6  COST 

39 

0 

36 

3196434 

41 

0 

37 

69167180 

47 

0 

53 

431596 

52 

0 

70 

0 

54 

5521 

30 

7984135 

56 

0 

32 

930236 

57 

17870 

35 

1141923 

58 

0 

86 

235130 

60 

0 

95 

0 

62 

0 

103 

303197 

63 

0 

112 

0 

68 

2131 

113 

230934 

73 

0 

116 

1921352 

74 

0 

117 

3039334 

75 

0 

122 

41778043 

76 

0 

73 


1567 


2/2 


AD-A174  395 


UNCLASSIFIED 

■■ 


AN  INVESTIGATION  OF  THE  IMPACT  OF  CONTRACT  CHANGES  ON 
COST  GROHTH  WITHIN  T  <U>  AIR  FORCE  INST  OF  TECH 
URIGHT-PATTERSON  AFB  OH  SCHOOL  OF  SVST  J  E  BLACKEN 
SEP  8b  AFIT/GSM/LSV/8bS-2  F/G  5/1  NL 


GROUP  1  (IN-SCOPE) 


GROUP  2  (OUT-OF-SCOPE) 


POOO#  FY8  6  COST 


107  0 

120  0 

130  0 


POOO#  FY8  6  COST 


34 


Appendix  H 


GROUP  1 

(UNDER  3  PGS) 

GROUP 

2  (3-5  PGS) 

GROUP  3 

(OVER  5 
PGS) 

POOO# 

FY8  6  COST 

POOO* 

FY8  6  COST 

POOO# 

FY8  6 
COST 

86 

1921352 

53 

431592 

37 

69167130 

95 

0 

30 

7984135 

85 

1141923 

116 

1921852 

82 

980236 

122 

41778043 

108 

303197 

113 

200984 

117 

3089334 

i 

i 

i 

* 

\ 


Appendix  I 


GROUP  1 

(COST-PLUS) 

GROUP  2 

(FIXED-PRICE) 

POOO# 

FY86  COST 

POOO# 

FY36  COST 

80 

1766627 

36 

3196434 

85 

1141923 

37 

69167180 

116 

1921852 

43 

563916 

53 

481596 

54 

5521 

57 

17873 

59 

11187518 

66 

1598217 

67 

2024438 

68 

2131 

77 

293144 

78 

1567 

80 

6217558 

82 

983236 

85 

1141923 

86 

236133 

89 

353730 

94 

3335166 

99 

368390 

100 

2008441 

108 

303197 

85 


-x 


GROUP  1  (COST-PLUS) 


GROUP  2  (FIXED- 
PRICE) 


POOP# 


FY8 6  COST  POOP#  FY8  6  COST 

113  200984 

116  1921352 

117  3089834 

122  41778043 


Appendix  J:  Data  Groups  for  Investigative  Question  2A 


GROUP  1  (CHANGE  ORDERS) 


GROUP  2  (SUPP  AGRMT) 


P000# 

FY8  6  COST 

POOO# 

FY86  COST 

36 

3196434 

39 

0 

37 

69167180 

41 

0 

53 

431596 

47 

0 

80 

7984185 

52 

0 

82 

980236 

54 

5521 

85 

1141923 

56 

0 

86 

236130 

57 

17870 

108 

303197 

58 

0 

113 

200984 

60 

3 

117 

3039834 

62 

0 

63 

0 

68 

2131 

71 

3 

73 

0 

74 

0 

75 

0 

76 

0 

78 

1567 

83 

0 

95 

0 

101 

3 

Appendix  K: 


GROUP  1  (CHANGE  ORDERS)  GROUP  2  (OTHER  SOW  CHANGES) 

POOP#  FY86  COST  POOP#  FY86  COST 

36  3196434 

37  69167130 

53  431596 

80  7984185 

82  980236 

35  1141923 

86  236130 

133  303197 

113  230934 


117 


3089334 


Appendix  L: 


V 

V 
‘V 


GR0UP1  (UNDER  5  MO'S)  GROUP2  (5-5  MO'S)  GROUP3  (OVER  6 

MO'  S) 


POOO# 

FY8  6  COST 

POOO# 

FY8  6  COST 

POOO# 

FY86  COST 

36 

236130 

35 

1141923 

5  3 

431596 

113 

230984 

116 

1921852 

30 

7984135 

117 

3089334 

32 

933236 

133 

303197 

Data  Groups  for  Investigative  Question  2D 


'  GROUP  1 

1 

> 

(UNDER  3  MO’S) 

GROUP  2 

(3-5  MO’ 3) 

GROUP  3 

(OVER  5 

MO’  S) 

1  POOO# 

i 

FY3  6  COST 

POOO# 

FY3  6  COST 

POOO# 

FY3  6 

COST 

37 

69167130 

53 

431596 

36 

3196434 

113 

233934 

85 

236130 

80 

7984185 

116 

1921352 

36 

236130 

32 

983236 

103 

303197 

117 

3389834 

-  *  V  V.  *  A  *  *  M  ?  »  »  »  •»  a  ,«  «.■  -V  ■  -  *•**_*.’ 


►  -  »  •  .  *  .  •  • 

.4  .  " 

V  .  *  .  /  -  »  .  *  r 


.'1  --i  *“v" 


GROUP  1  (NTS) 


GROUP  2  (FINAL) 


POOO# 

FY36  COST 

POOO# 

FY86  COST 

43 

568915 

53 

431596 

59 

11187518 

80 

7984185 

66 

1598217 

82 

930236 

67 

2324438 

85 

1141923 

77 

293144 

36 

236130 

89 

353733 

103 

303197 

94 

3335166 

113 

203984 

99 

368890 

116 

1921852 

133 

2333441 

117 

3089834 

Appendix  0 


Data  Groups  for  Invest igative  Question  2F 


GROUP  1  (1982)  GROUP  2  (1933)  GROUP  3  (1984)  GROUP  4 

(1985) 


FY8  6 
COST 

POOO# 

FY8  6 

COST 

POOO# 

FY8  6 
COST 

FY8  6 
COST 

39 

0 

36 

3196434 

73 

0 

112 

0 

41 

3 

37 

69157180 

74 

0 

113 

200934 

43 

568916 

47 

0 

75 

0 

116 

1921352 

52 

3 

76 

0 

117 

3039834 

53 

481596 

77 

298144 

120 

0 

54 

5521 

78 

1567 

122 

41778043 

57 

17870 

80 

7984185 

133 

0 

58 

0 

32 

930236 

59 

11187513 

33 

0 

63 

0 

35 

1141923 

62 

0 

36 

236130 

63 

3 

89 

353730 

6  6 

1598217 

94 

3335166 

67 

2024408 

95 

3 

68 

2131 

99 

363390 

130  2008441 
101  3 

13  3  0 


138  303197 


GROUP  1  (DELIVERY  IMPACT) 


GROUP  2  (OTHERS) 


POOP#  FY86  COST 


POOP# 

95 

131 

103 

137 

117 

120 

130 


FY86  COST 
0 
0 
0 
0 

3089334 

0 

0 


96 


Appendix  Q: 


Data  Groups  for  Investigative  Question  3B 


GROUP  1  (DELIVERY  IMPACT)  GROUP  2  (OTHER  SOW  CHANGES) 


POOO# 

FY86  COST 

POOO# 

FY86  COST 

36 

3196434 

32 

983236 

37 

69167133 

85 

1141923 

33 

481596 

94 

3335166 

30 

7984185 

95 

0 

36 

236130 

117 

3089834 

133 

303197 

112 

0 

113 

230934 

116 

1921352 

122 

41773043 

Appendix  R 


GROUP  1  (UNDER  20  PGS)  GROUP  2  (OVER  20  PGS) 


POOO# 

FY8  6  COST 

36 

3196434 

53 

481596 

82 

980236 

86 

236130 

108 

303197 

115 

1921352 

POOO# 

FY86  COST 

37 

69167180 

80 

7984135 

85 

1141923 

113 

203984 

117 

3039834 

GROUP  1 (UNDER  10  MO'S)  GROUP  2(10-25  MO'S)  GROUP  3 (OVER  25 

MO'  S) 


I 


.tj 

*] 

J 

«j 


a 


i 


POOO# 

COST 

FY36  COST 

POOO# 

FY86  COST 

POOO# 

FY86 

32 

980236 

67 

2024408 

36 

3196434 

86 

236130 

30 

7984185 

37 

69167130 

100 

2008441 

85 

1141923 

53 

481596 

108 

303197 

116 

1921352 

113 

200984 

117 

3039834 

*1 

T 


Appendix  T:  Sample  AFSC  Form  702-Amendment  of 

Solicitation/Modif ication  of  Contract 


AMENDMENT  OF  SOLICJTATION/MODIFICATION  OF  contract  rel/Iu 


2.  PR0C  INSTRUMENT  10  *0.  tPHRI 


F33657-80-C-0441  I  P00036  I  83JAN11 


-  wwr»*  /  •••  (Ml  -  M  ■  » 

Aeronautical  Systems  Division 
Wright-Patterson  AFB,  OH  45433 
Buyer:  G.  Germann,  ASD/RWKRC 

(513)  255-6045 


AOminIITCRED  *t  ( t r  OThER  Um  SlOCk  7) 

DCASMA  Orlando 
3555  Maguire  Blvd. 
Orlando,  FL  32803 


MAILING  DATE  MAR  3  1 1983 


CONTRACTOR 
KAMI  AMO  AO  OR  CSS 


FACILITY  COOC 


no.  security  cl  as 


martin  marietta  corporation 

ORLANDO  DIVISION 
P.0.  BOX  5837 
ORLANDO,  FL  32855 


11.  this  BLOCK  APPLIES  only  TO  amCnOmCmTS  of  SOLICITATIONS 


IF  FOR 

MULTIPLE 

facilitics 
set  SCCT 


\M.  PURCHASE  OFFICE  POINT  OF  CONTACT 


AEE/A35/APV 


I  I  * 


«  ••  MMM  m  HA  Mf  el  «Mer  ■ 


I  •*  mm  MMM;  m  S*  •*  MNM  «•  MM  MPT  M  *H*r  MmN'  •»  Ul  Bf  MNH INM  f  MM*  MpN  MW  a  INIIMII 

IAR4M  0*  TOUt  ACtMOmOOMlwnO  M  lKlNTO  SI  Tm  lUM  0PHCI  PB*i  TO  Tlfl  MOMS  AMO  OATt  «PtC*«0  MAY  RUUT  Nh JKTION  0*  TOUR  9"W  4  * 


14.  TMIS  BaOCK  APPLIES  OMLT  TO  MODIFICATIONS  OF  COMTRACTS 

D  TMIS  CMAMBC  IS  IBSUC0  pur SU AMT  to  — 

TMC  CMAN0CS  SCT  FORTH  MCRCIM  ARC  MADE  TO  TMl  AtOVt  mumOCRCC  COMTRaCT/OROCR. 

G  TNC  ABOVt  NUMBERED  CONTRACT  is  MOOlFlCC  TO  RCFlCCT  The  ADMINISTRATIVE  CmahSCS  ISUCn  as  CHAMBCS  IN  PATINO  OFFICE.  APPROPRIATION 
DATA.  ETC.)  SCT  FORTh  NCRtlN. 

5  tmis  supplemental  asrccmemt  is  emtcrco  imto  pwrsuant  to  autmoritt  of  _the_  Terins  and  Condition*  Qf 
mooifics  the  above  mumbcrco  contract  as  sit  forth  MCRtiN.  P00032  and  10  C . S  . C .  Chapter  137. 

n  TMIS  MODIFICATION  IS  issuto  PURSUANT  TO 


*.  CONTRACT  ADMINISTRATION  OATa 

4i  «IN0  A.  MOO  AOOT  t(  OATC  of  OIOmaTuRI  0.  CmAHOK  ih  CONTRACT  AMOvhT  t.  *o/cao  r,  OAIMIM*  ho'c.o  «.  ovc/*ocnct 

*OF  MOO  •CCiF'CNT  AON  AT  MODIFICATION  INCNCASC  OICFUK  \  -)  OH  TO  AH  HI*  OH  TNanRFCK  Ut| 


3  1 000  #000 . 00+ 


ANT  APPLICABLE  Chaoses 


c.  CONTRACT  I.  SKCUNITv 

A.  r**T  O.  «rr*«TlVt  BATE  YVOf  t.OU«V  ONlCOHTN  6  MTl.l  OlC  «.  OATCoiO««r 


PAV  OF  AWAOO 


IIITVOf  laiOINB 


COHTO  CH*Y  MaviSlfal  coot 


I1ICLAA  Utl  OATC  of  OO  >04 


REMARKS  (£xcmi  m  previdot  Morom,  mil  iIbni  and  condiiioni  o I  IM  com/oci,  o«  horoioloro  cAonooR.  rtmain  uncA«n|«E  mna  in  lull  lore*  and 
•  IIOCI.J 


-€ubject:  Acquisition  of  Infrared  Detectors. 

Change  in  Contract  Price:  $3,000,000.00  (Increase) 


COM TRACTOR /OFFEROR  is  NOT  RCOUiRCD 
TO  SION  This  DOCUMENT 


CONTRACTOR/OFFEROR  is  RCOUIRCD  TO  SlBN  THIS  OOCUMChT  anO  RfT«R* 
^  COPIES  TO  ISBUIN6  OFFICE 


1.  CONTRACTOR/Ofri 


.  DATE  SlOMCD 


ontracts  tenaoer,  LANTTRN  Procram  83MAR1E 


”  V"*  7  Q2 

MOV  ?* 


Appendix  U:  Sample  AFSC  form  705-Supplies  Line  Item  Data 

PART  1  SECTION  B  OF  THE  SCHEDULE  ~  **c<  =RS=I"  10  **•  ,,nm' 

SUPPLIES  LIME  ITEM  data  F3 36 57-80-C-044 1 


i.  ItKm  56!  t.  DuMTITY*  4.  PW«CP  T.  tMlT  Mice  4.  TOIa*  fTt«  am«m«t« 

INI  IT 

0014  +  *  * 

I  UTTKO.ACMi  II.  «*N  fKu  MB  Pitt  NHMII  U. 

Cl  as 


14.  Sttc  COOCI  It. 

A.»«4i  ».A(»  C.P»P 


14.  »VC/UUCT  uSC 


INFRARED  DETECTORS 


IT.  P«/MIP«  DATA 


«•.  AUlMOftlXCD  SATt  COUTSACT  2C.  »vC  10  •©.  21.  m4A 

B«T  L*UM«>  l»Nf»CUT  r Cl 


TV  «ST  ttiSCkWT  •  21.  2 Mb  DIICftwT  24.  ISO  DISCOUNT  „  *»rr  24.  OmmTITT  V4«IMC( 

M4f|  •  4.  I.MTI  A.  **•  OAYl  4. 


„  24. 

''•COuTSaCT 


21.  DCSCfttfTlvC  »AtA 


ASSURE  A  SOURCE  OF  HIGH  QUALITY  INFRARED  DETECTORS  IN  ACCORDANCE  KITH 
PARAGRAPH  4210.3.6  OF  THE  STATEMENT  OF  WORK  AERS  79-07,  SECTION  A, 
DATED  30  JULY  1982,  INCORPORATED  HEREIN  BY  REFERENCE  AND  CONSISTING 
OF  THE  FOLLOWING  SUBLINE  ITEMS: 


0014AA+  ,  12 

cuss 

D  AH  N 

U.  »m  COOCS  It.  NOW" 

*.«»•*  a.  ac  p  C.r*a 


EA  *  150 , 656 . 00 

12.  rtCM  AMO  SAKT  M 


OlAL  IT Lm  amount 


1  1/ 807 , 872. 00 


14.  SVC/ASCNCT  U$t 


S  S  S  COMMON  MODULE  DETECTOR 

T7.  DA74  14.  auTnOSiXI 


4.  auTmMiCCO  «aTC 
4.PBM4U*  AAV  S."CC*WP 


„  FY*7  6 1 5-B  2 -  0 1 3  87 

22-  rST  DISCOUNT _ 7a.  2«C 


scstrnvc  data 


2*0  DISCOUNT  24.  240  DISCOUNT  S1  NCT  24.  OuanTITy  va«ia»C( 

uni  a.  a.sayc  •••days  a.  »*i«  a. 


Tt»C  24.  ON 


MANUFACTURE,  TEST  AND  DELIVER  COMMON  MODULE  INFRARED  DETECTORS  IN 
ACCORDANCE  WITH  PARAGRAPH  4210.3.6.1  OF  THE  STATEMENT  OF  WORK 
AERS  79-07,  SECTION  A,  DATED  30  JULY  1982.  DETECTORS  SHALL  BE  USED 
IN  SUPPORT  OF  CLIN  0002. 


TPtUINTS  NF  AMOUNT  Of  INCttASt/DICItASE  WNfN  MODIFYING  DUSTING  ITIM  NO 

W  m  NOT  AFFUCAIU  |.  (fTIMATID 

U  m  UNOfNNfTTUD  -  IM  OTY  AND  *)■  DICIIASt 

W»  NOT  WUAmT  TCIC1S  —  Ot  -  (If.  ITIM  NO.)  ■  ADDITION  Ot  D&fTTON 
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